-- Logs begin at Mon 2022-09-19 11:13:57 UTC, end at Mon 2022-09-19 12:46:24 UTC. -- Sep 19 11:48:46.415971 dv-cinder-858293-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 11:48:46.425716 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:48:46 2022] *** Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: nodename: dv-cinder-858293-1-iscsi Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: machine: x86_64 Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: clock source: unix Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: pcre jit disabled Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: detected number of CPU cores: 4 Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: current working directory: / Sep 19 11:48:46.427724 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:48:46.428546 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: your processes number limit is 47680 Sep 19 11:48:46.428546 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: your memory page size is 4096 bytes Sep 19 11:48:46.428546 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: detected max file descriptor number: 2048 Sep 19 11:48:46.428546 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: lock engine: pthread robust mutexes Sep 19 11:48:46.428546 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: thunder lock: enabled Sep 19 11:48:46.428546 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 11:48:46.428546 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:48:46.468020 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: Python main interpreter initialized at 0x56453d6679c0 Sep 19 11:48:46.468020 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: python threads support enabled Sep 19 11:48:46.468020 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: your server socket listen backlog is limited to 100 connections Sep 19 11:48:46.468020 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:48:46.468481 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:48:46.468481 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: *** Operational MODE: preforking *** Sep 19 11:48:46.468730 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:48:46.468730 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: spawned uWSGI master process (pid: 105409) Sep 19 11:48:46.468941 dv-cinder-858293-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 11:48:46.469515 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: spawned uWSGI worker 1 (pid: 105410, cores: 1) Sep 19 11:48:46.469872 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: spawned uWSGI worker 2 (pid: 105411, cores: 1) Sep 19 11:48:46.470048 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:48:47.132733 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:48:47.134427 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:48:48.227295 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:48:48.227295 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Sep 19 11:48:48.227979 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:48:48.227979 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Sep 19 11:48:48.228302 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:48:48.228302 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: from cryptography.utils import int_from_bytes Sep 19 11:48:48.228760 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:48:48.228760 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: from cryptography.utils import int_from_bytes Sep 19 11:48:50.716810 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:48:50.717393 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:48:50.717781 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:48:50.717900 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:48:50.717995 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:48:50.718085 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:48:50.718168 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:48:50.718249 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:48:50.718330 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:48:50.718432 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:48:50.718578 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.718864 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.718979 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.719128 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.719220 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.719446 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.719538 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.719761 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.719865 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.720091 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.720184 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.720398 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.720486 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.720714 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.720819 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.721029 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.721128 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.721282 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.721379 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.721590 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.721679 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.721930 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.722034 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858293-1-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.722245 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.722333 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858293-1-iscsi {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.722543 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.722642 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.722847 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.722947 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.723151 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.723246 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.723444 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.723542 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.723754 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.723842 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.724051 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.724139 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.724366 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.724542 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.724869 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.725020 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.725179 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.725299 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.725480 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.725599 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.725816 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.726016 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.726139 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.726252 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.726454 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.726593 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.726742 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.726845 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.727062 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.727181 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.727368 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.727467 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.727669 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.727765 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.727978 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.728072 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858293-1-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.728362 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.728470 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858293-1-iscsi {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.728667 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.728757 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.728973 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.729080 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.729283 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.729392 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.729675 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.729793 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.730008 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.730196 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.730311 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.730517 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.730653 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.730738 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.730917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.731010 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.731238 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.731334 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.731553 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.731644 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.731865 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.731956 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.732179 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.732269 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.732476 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.732566 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.732780 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.732870 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.733082 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.733178 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.733389 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.733474 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.733707 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.733819 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734035 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734138 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734282 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734390 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734583 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734680 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734875 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.734973 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.735188 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.735290 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.735503 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.735596 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.735751 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.735842 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.735999 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.736091 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.736291 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.736387 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.736612 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.736724 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.736911 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.737041 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.737212 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.737317 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.737512 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.737612 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.737834 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.737928 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.738137 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.738237 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.738437 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.738537 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.738733 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.738830 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.739032 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.739131 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.739336 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.739441 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.739641 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.739730 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.739950 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.740039 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.740250 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.740351 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.740558 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.740654 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.740876 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.741019 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.741178 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.741281 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.741481 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.741579 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.741814 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.741905 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.742147 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.742238 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.742449 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.742539 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.742753 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.742851 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.743065 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.743155 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.743367 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.743466 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.743666 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.743759 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.743964 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.744060 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.744267 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.744358 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.744599 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.744716 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.744893 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.745013 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.745133 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.745237 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.745424 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.745530 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.745718 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.745826 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.746046 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.746137 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.746345 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.746466 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.746647 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.746782 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.746948 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.747052 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.747240 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.747343 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.747535 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.747624 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.747832 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.747920 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.748131 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.748221 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.748434 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.748532 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.748731 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.748819 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.749028 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.749130 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.749866 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.749987 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.750172 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.750277 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.750465 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.750556 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.750761 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.750852 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.751060 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.751153 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.751376 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.751465 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.751676 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.751779 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.751973 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.752079 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.752276 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.752378 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.752572 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.752662 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.752872 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.752970 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.753168 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.753258 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.753466 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.753556 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.753780 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.753872 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.754086 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.754178 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.754382 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.754472 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.754682 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.754781 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.754980 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.755070 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.755278 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.755378 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.755578 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.755682 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.755870 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.755960 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.756166 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.756258 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.756466 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.756635 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.756768 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.756878 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.757064 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.757163 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.757358 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.757477 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.757652 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.757743 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.757971 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.758063 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.758267 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.758366 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.758558 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.758647 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.758853 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.758944 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.759145 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.759243 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.759443 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.759532 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.759750 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.759839 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.760050 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.760149 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.760348 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.760438 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.760642 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.760732 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.760939 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.761076 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.761258 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:48:50.761352 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.761580 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.761676 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.761933 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.762040 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.762244 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.762333 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.762572 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.762678 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.762897 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.762995 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.763210 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.763307 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.763515 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.763619 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.763822 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.763913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.764132 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.764231 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.764435 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.764537 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.764740 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.764836 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.765140 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.765743 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.765984 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.766104 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.766302 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.766406 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.766619 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.766719 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.766951 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.767052 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.767267 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.767358 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.767582 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.767673 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.767897 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.768001 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.768207 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.768297 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.768522 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.768612 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.768837 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.768926 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.769151 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.769239 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.769460 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.769548 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.769817 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.769914 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.770131 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.770218 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.770454 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.770559 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.770769 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.770870 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.771067 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.771159 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.771376 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.771486 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.771678 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.771768 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.771988 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.772066 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.772303 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.772419 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.772609 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.772700 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.772922 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.773013 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.773227 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.773327 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.773534 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.773636 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.773880 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.774084 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.774158 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.774243 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.774462 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.774609 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.774768 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.774875 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.775092 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.775223 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.775377 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.775470 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776225 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776339 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776339 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776510 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776510 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776660 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776752 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776836 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.776932 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.777193 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.777292 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.777377 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.777483 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.777574 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.777804 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.777900 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.778108 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.778205 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.778409 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.778498 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.778706 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.778797 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.779011 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.779159 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.779300 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.779390 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.779600 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.779693 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.779915 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.780009 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.780214 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.780313 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.780527 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.780626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.780853 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.780942 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.781158 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.781259 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.781461 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.781551 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.781811 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.781919 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.782087 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.782194 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.782394 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.782486 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.782699 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.782841 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.782980 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.783138 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.783280 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.783416 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.783591 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.783684 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.783890 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.783986 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.784193 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.784309 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.784494 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.784585 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.784796 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.784888 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.785098 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.785187 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.785401 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.785488 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.785707 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.785829 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.786075 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.786181 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.786341 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.786439 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.786645 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.786737 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.786953 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.787041 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.787258 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.787370 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.787563 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.787652 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.787893 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.787980 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.788193 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.788301 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.788505 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.788594 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.788821 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.788909 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.789139 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.789241 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.789440 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.789537 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.789742 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.789865 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.790062 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.790163 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.790360 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.790455 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.790662 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.790752 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.790959 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.791038 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.791258 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.791357 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.791555 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.791657 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.791852 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.791942 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.792151 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.792229 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.792599 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.792697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.792794 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.792877 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.793057 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.793155 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.793352 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.793439 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.793649 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.793740 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.793973 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.794069 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.794274 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.794382 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.794594 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.794688 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.794901 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.794990 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.795242 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.795342 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.795553 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.795643 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.795873 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.795970 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.796200 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.796300 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.796513 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.796604 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.796818 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.796920 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.797128 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.797242 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.797426 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.797525 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.797729 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.797846 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.798058 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.798149 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.798361 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.798450 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.798675 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.798770 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.798980 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.799078 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.799333 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.799431 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.799589 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.799679 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.799900 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.799990 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.800198 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.800285 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.800505 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.800593 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.800818 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.800914 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.801148 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.801237 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.801460 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.801549 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.801784 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.801879 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.802096 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.802197 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.802404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.802503 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.802709 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.802798 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.803011 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.803102 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.803315 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.803417 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.803617 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.803705 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.803921 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.804009 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.804221 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.804319 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.804529 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.804620 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.804829 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.804918 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.805136 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.805235 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.805437 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.805577 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.805747 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.805896 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.806067 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.806202 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.806371 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.806511 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.806679 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.806822 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.807003 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.807139 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.807286 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.807381 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.807593 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.807740 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.807960 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.808099 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.808237 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.808372 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.808508 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.808657 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.808803 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.808939 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.809077 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.809224 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.809361 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.809515 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.809653 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.809831 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.810020 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.810158 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.810334 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.810484 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.810642 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.810781 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.810945 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.811078 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.811226 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.811562 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.812345 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.812498 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.812498 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.812776 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.812912 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.813058 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.813202 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.813339 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.813339 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.813596 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.813596 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.813896 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.814036 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.814172 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.814315 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.814451 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.814603 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.814742 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.814989 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.815124 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.815256 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.815393 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.815543 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.815682 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.815829 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.815965 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.816101 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.816235 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.816379 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.816515 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.816651 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.816788 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.816924 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817059 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817204 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817350 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817494 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817659 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817745 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817892 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.817985 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.818076 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.818243 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.818333 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.818545 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.818656 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.818846 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.818935 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.819160 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.819249 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.819471 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.819578 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.819771 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.819861 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.820074 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.820161 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.820375 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.820474 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.820677 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.820768 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.820981 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.821076 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.821287 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.821385 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.821583 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.821679 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.821920 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.822011 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.822222 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.822312 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.822520 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.822610 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.822819 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.822907 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.823130 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.823219 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.823439 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.823698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.824003 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.824093 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.824320 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.824416 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.824627 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.824707 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.824936 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.825044 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.825252 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.825361 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.825578 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.825679 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.825922 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.826015 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.826231 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.826320 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.826532 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.826624 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.826835 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.827218 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.827385 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.828051 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.828243 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.828364 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.828545 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.828640 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.828851 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.828955 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.829147 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.829238 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.829516 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.829621 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.829748 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.829869 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.830071 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.830162 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.830369 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.830463 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.830666 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.830773 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.830964 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.831070 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.831269 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.831367 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.831563 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.831664 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.831868 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.831982 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.832169 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.832263 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.832470 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.832557 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.832861 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.832967 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.833055 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.833238 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.833341 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.833423 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.833634 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.833734 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.833970 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.834083 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.834277 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.834377 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.834674 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.834794 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.834922 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.835008 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.835247 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.835345 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.835547 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.835681 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.835847 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.835950 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.836165 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.836264 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.836468 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.836568 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.836770 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.836879 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.837082 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.837183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.837365 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.837464 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.837662 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.837799 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.837985 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.838086 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.838285 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.838383 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.838585 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.838684 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.838888 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.838986 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.839186 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.839284 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.839485 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.839585 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.839779 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.839877 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.840073 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.840173 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.840372 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.840471 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.840670 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.840776 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.840968 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.841068 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.841262 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.841363 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.841559 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.841657 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.841886 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.841989 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.842184 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.842282 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.842484 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.842592 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.842775 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.842889 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.843103 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.843210 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.843403 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.843509 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.843702 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.843812 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.843999 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.844107 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.844297 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.844396 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.844595 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.844707 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.844892 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.845011 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.845191 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.845296 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.845499 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.845607 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.845816 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.845930 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.846117 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.846218 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.846417 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.846524 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.846711 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.846809 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.847006 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.847106 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.847302 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.847400 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.847605 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.847752 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.847922 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.848072 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.848225 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.848375 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.848522 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.848662 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.848800 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.848936 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.849087 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.849226 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.849373 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.849511 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.849674 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.849841 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.849999 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.850144 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.850284 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.850429 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.850568 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.850713 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.850854 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.850993 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.851156 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.851307 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.851444 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.851592 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.851760 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.851896 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.852061 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.852154 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.852356 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.852501 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.852642 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.852775 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.852946 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.853082 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.853245 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.853388 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.853570 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.853705 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.853897 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.854040 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.854193 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.854343 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.854489 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.854627 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.854789 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.854926 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.855089 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.855236 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.855385 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.855526 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.855664 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.855803 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.855947 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.856093 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.856232 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.856368 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.856541 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.856690 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.856828 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.856973 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.857119 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.857257 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.857399 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.857550 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.857710 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.857878 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.858051 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.858188 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.858365 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.858519 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.858699 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.858835 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.859019 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.859169 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.859308 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.859455 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.859642 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.859782 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.859922 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.860070 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.860210 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.860423 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.860569 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.860717 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.860857 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.861016 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.861163 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.861302 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.861386 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.861534 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.861668 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.861855 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862008 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862155 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862291 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862428 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862567 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862660 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862858 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.862995 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.863166 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.863303 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.863472 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.863621 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.863767 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.863904 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.864082 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.864229 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.864368 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.864517 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.864655 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.864810 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.864950 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.865189 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.865271 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.865359 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.865543 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.865642 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.865883 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.865978 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.866280 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.866390 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.866588 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.866688 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.866886 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.866976 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.867184 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.867273 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.867488 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.867580 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.867778 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.867870 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.868085 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.868177 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.868383 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.868473 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.868682 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.868785 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.869090 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.869181 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.869395 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.869483 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.869700 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.869805 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.870030 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.870130 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.870328 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.870419 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.870628 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.870716 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.870936 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.871027 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.871259 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.871361 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.871560 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.871667 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.871862 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.871952 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.872163 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.872253 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.872466 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.872579 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.872770 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.872861 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.873094 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.873192 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.873476 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.873579 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.873790 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.873881 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.874108 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.874217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.875016 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.875109 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.875323 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.875412 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.875631 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.875732 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.875948 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.876085 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.876266 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.876360 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.876564 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.876661 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.876872 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.876963 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.877174 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.877274 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.877479 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.877690 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.877822 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.877912 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.878136 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.878229 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.878448 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.878527 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.878754 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.878846 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.879070 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.879150 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.879384 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.879462 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.879692 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.879780 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.880001 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.880087 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.880323 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.880403 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.880713 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.880800 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.881019 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.881098 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.881335 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.881413 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.881652 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.881784 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.881979 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.882059 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.882301 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.882391 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.882649 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.882814 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.882955 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.883091 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.883224 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.883373 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.883520 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.883658 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.883797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.883934 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.884077 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.884214 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.884358 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.884493 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.884628 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.884764 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.884910 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.885047 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.885191 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.885274 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.885510 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.885604 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.885834 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.885940 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.886140 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.886230 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.886448 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.886538 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.886757 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.886859 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.887069 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.887157 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.887368 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.887465 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.887677 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.887774 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.887977 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.888075 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.888274 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.888365 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.888572 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.888675 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.888871 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.888961 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.889172 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.889261 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.889491 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.889588 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.889824 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.889950 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.890204 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.890429 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.890536 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.890624 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.890853 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.890943 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.891162 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.891251 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.891487 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.891577 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.891804 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.891907 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.892106 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.892205 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.892410 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.892500 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.892725 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.892814 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.893028 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.893121 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.893326 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.893419 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.893629 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.893867 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.893954 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.894051 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.894238 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.894330 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.894537 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.894646 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.894839 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.894941 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.895137 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.895228 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.895434 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.895576 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.895731 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.895831 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.896031 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.896119 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.896331 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.896422 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.896644 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.896743 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.896945 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.897048 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.897244 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.897343 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.897541 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.897633 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.897872 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.897963 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.898148 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.898237 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.898464 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.898563 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.898778 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.898867 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.899082 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.899181 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.899396 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.899489 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.899705 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.899793 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.900018 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.900106 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.900326 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.900416 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.900637 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.900726 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.900944 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.901043 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.901255 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.901344 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.901564 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.901653 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.901893 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.902015 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.902197 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.902287 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.902503 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.902594 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.902812 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.902910 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.903126 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.903356 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.903680 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.903772 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.903987 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.904085 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.904295 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.904394 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.904602 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.904693 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.904911 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.905003 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.905221 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.905320 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.906053 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.906153 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.906367 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.906460 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.906676 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.906767 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.906983 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.907074 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.907310 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.907403 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.907629 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.907720 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.907949 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.908048 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.908280 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.908372 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.908596 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.908688 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.908909 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.909009 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.909265 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.909480 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.909621 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.909787 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.909924 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.910076 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.910217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.910354 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.910521 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.910658 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.910830 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.910966 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.911139 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.911285 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.911447 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.911591 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.911751 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.911906 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.912043 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.912138 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.912348 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.912448 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.912652 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.912743 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.912954 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.913107 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.913241 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.913387 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.913548 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.913684 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.913876 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.914013 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.914195 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.914414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.914561 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.914700 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.914836 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.914984 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.915131 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.915270 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.915415 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.915553 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.915690 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.915827 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.916059 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.916178 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.916488 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.916623 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.916818 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.916958 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.917142 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.917283 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.917461 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.917602 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.917787 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.917948 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.918161 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.918362 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.918502 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.918640 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.918777 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.918924 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919060 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919205 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919342 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919438 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919587 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919688 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919890 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.919981 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.920205 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.920303 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.920509 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.920614 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.920806 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.920904 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.921104 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.921278 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.921476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.921570 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.921803 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.922026 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.922342 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.922436 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.922668 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.922759 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.922988 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.923088 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.923308 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.923398 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.923622 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.923714 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.923923 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.924013 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.924235 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.924324 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.924535 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.924686 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.924822 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.924963 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.925113 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.925219 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.925422 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.925563 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.925873 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.926039 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.926191 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.926386 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.926481 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.926667 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.926760 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.926931 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.927072 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.927225 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.927403 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.927542 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.927681 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.927852 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.927989 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.928166 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.928302 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.928468 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.928612 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.928796 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.928958 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.929109 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.929263 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.929375 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.929587 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.929723 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.929970 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.930073 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.930316 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.930454 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.930589 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.930723 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.930924 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.931069 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.931230 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.931390 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.931529 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.931664 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.931811 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.932060 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.932154 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.932445 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.932578 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.932746 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.932889 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.933064 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.933211 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.933346 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.933494 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.933637 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.933819 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.933955 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.934095 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.934241 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.934379 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.934564 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.934711 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.934871 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.935007 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.935162 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.935309 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.935502 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.935643 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.935813 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.935948 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.936131 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.936346 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.936536 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.936671 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.936829 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.937016 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.937177 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.937344 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.937617 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.937781 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.937978 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.938115 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.938278 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.938420 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.938580 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.938714 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.938899 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.939055 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.939207 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.939352 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.939530 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.939678 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.939812 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.939958 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.940101 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.940246 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.940381 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.940521 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.940683 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.940827 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.940969 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.941111 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.941275 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.941421 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.941581 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.941715 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.941882 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.942022 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.942180 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.942273 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.942481 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.942625 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.942780 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.942920 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.943083 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.943175 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.943390 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.943604 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.943742 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.943879 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.944123 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.944266 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.944403 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.944552 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.944698 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.944844 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.944980 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.945138 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.945303 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.945439 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.945577 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.945715 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.945845 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.945990 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.946131 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.946279 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.946417 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.946516 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.946700 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.946844 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.947037 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.947186 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.947325 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.947462 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.947599 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.947929 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.948073 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.948241 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.948378 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.948544 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.948680 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.948864 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.949170 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.949313 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.949488 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.949581 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.949828 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.949979 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.950142 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.950277 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.950458 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.950600 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.950746 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.950886 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.951074 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.951219 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.951401 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.951541 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.951722 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.951869 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.952296 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.952385 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.953111 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.953251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.953397 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.953486 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.953700 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.953833 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.954031 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.954181 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.954345 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.954459 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.954648 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.954768 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.954948 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.955072 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.955247 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.955379 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.955549 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.955697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.955847 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.956005 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.956147 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.956310 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.956446 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.956617 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.956744 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.956915 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.957046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.957218 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.957344 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.957519 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.957643 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.957841 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.957966 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.958147 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.958267 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.958453 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.958557 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.958755 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.958846 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.959058 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.959158 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.959366 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.959507 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.959668 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.959768 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.959971 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.960074 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.960267 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.960379 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.960569 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.960670 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.960865 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.960964 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.961166 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.961268 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.961464 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.961564 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.961776 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.961878 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.962082 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.962182 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.962414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.962528 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.962716 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.962823 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.963040 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.963134 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.963364 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.963529 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.963691 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.963828 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.963975 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.964110 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.964270 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.964404 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.964573 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.964728 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.964867 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.965004 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.965172 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.965311 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.965475 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.965633 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.965829 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.965968 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.966106 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.966244 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.966390 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.966536 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.966710 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.966889 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.966986 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.967071 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.967294 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.967395 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.967599 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.967696 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.968013 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.968290 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.968390 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.968597 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.968702 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.968919 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.969008 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.969227 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.969326 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.969533 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.969624 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.969868 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.969987 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.970171 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.970262 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.970480 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.970579 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.970790 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.970891 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.971192 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.971292 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.971384 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.971468 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.971692 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.971794 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.971999 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.972088 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.972310 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.972408 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.972621 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.972812 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.972906 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.972989 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.973228 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.973339 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.973538 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.973638 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.973887 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.973990 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.974194 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.974293 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.974608 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.974714 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.974842 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.974948 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.975150 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.975241 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.975457 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.975548 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.975756 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.975846 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.975993 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:48:50.976119 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.976445 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.976758 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.977068 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.977372 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:48:50.977613 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:48:51.130182 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Registered counter for database nova_api Sep 19 11:48:51.133629 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Registered counter for database nova_api Sep 19 11:48:51.152782 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.154539 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.159580 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.160953 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.220260 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.context [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da7f277f-e3d5-498c-9c41-09e6e3516152(cell1) {{(pid=105410) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:48:51.221057 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.context [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da7f277f-e3d5-498c-9c41-09e6e3516152(cell1) {{(pid=105411) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:48:51.224041 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:51.224502 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:51.224992 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:51.225468 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:51.226072 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:51.226954 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:51.227158 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:51.227328 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:51.227882 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:51.228334 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:51.229300 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:51.230347 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:51.231319 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Registered counter for database nova_cell0 Sep 19 11:48:51.232425 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Registered counter for database nova_cell0 Sep 19 11:48:51.235908 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Registered counter for database nova_cell1 Sep 19 11:48:51.237106 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Registered counter for database nova_cell1 Sep 19 11:48:51.243270 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.245051 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.246616 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.248434 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.249242 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.254046 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.390777 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.391171 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.399750 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Registered counter for database nova_cell0 Sep 19 11:48:51.400249 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Registered counter for database nova_cell0 Sep 19 11:48:51.409226 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.412751 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:48:51.414097 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.417559 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:48:51.758475 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:48:51.765888 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:48:51.808115 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:48:51.817367 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:48:52.112934 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:48:52.119440 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:48:52.125034 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56453d6679c0 pid: 105410 (default app) Sep 19 11:48:52.127350 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:52.128598 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] 10.222.0.88 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001938 Sep 19 11:48:52.131081 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 788 bytes} [Mon Sep 19 11:48:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:48:52.220668 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:48:52.227730 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-6278eb9b-9230-40aa-bee5-224ceaaea185 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:48:52.234503 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56453d6679c0 pid: 105411 (default app) Sep 19 11:50:15.184895 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:15.185961 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 19 11:50:15.191735 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 2/2] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:15.205337 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:15.206947 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell0:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:15.207704 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell1:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:15.208422 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:16.068737 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-cefa1941-7217-466c-8e47-89f09ec93bfb admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:16.103801 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-cefa1941-7217-466c-8e47-89f09ec93bfb admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909474 Sep 19 11:50:16.105008 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 1/3] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Sep 19 11:50:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:18.807747 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:18.808794 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0856ce59-a947-4f27-ad70-21fdffc95021 None None] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 19 11:50:18.809383 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 3/4] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:19.278770 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-de06ca2c-671b-44a7-b4a3-ce78dd91ca3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "vcpus": 1}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:19.327567 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-de06ca2c-671b-44a7-b4a3-ce78dd91ca3e admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.511563 Sep 19 11:50:19.328447 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 2/5] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:19.343003 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:19.343865 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell1:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:19.346405 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:19.347533 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:19.565572 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-dc585010-793c-4e79-98a2-fbb54d656303 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:19.636910 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-dc585010-793c-4e79-98a2-fbb54d656303 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.300337 Sep 19 11:50:19.637600 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 4/6] 10.222.0.88 () {64 vars in 1336 bytes} [Mon Sep 19 11:50:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:22.286943 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-de06ca2c-671b-44a7-b4a3-ce78dd91ca3e admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:22.287959 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-de06ca2c-671b-44a7-b4a3-ce78dd91ca3e admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 19 11:50:22.288844 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 3/7] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:22.958034 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-72d8b76d-6bfc-4f2e-be3d-651ca20218ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "vcpus": 1}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:22.996816 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-72d8b76d-6bfc-4f2e-be3d-651ca20218ec admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700976 Sep 19 11:50:23.004380 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 5/8] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:23.009855 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c873bf4e-5ef4-482e-a985-5bd8240a8257 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:23.051828 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c873bf4e-5ef4-482e-a985-5bd8240a8257 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045665 Sep 19 11:50:23.052473 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 4/9] 10.222.0.88 () {64 vars in 1336 bytes} [Mon Sep 19 11:50:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:25.673623 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-72d8b76d-6bfc-4f2e-be3d-651ca20218ec admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:25.674697 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-72d8b76d-6bfc-4f2e-be3d-651ca20218ec admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Sep 19 11:50:25.675122 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 6/10] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:26.114276 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-808c420c-ebc7-4397-a976-d16751ed2697 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "swap": 0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "ram": 1024}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:26.143377 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-808c420c-ebc7-4397-a976-d16751ed2697 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461380 Sep 19 11:50:26.144166 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 5/11] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:26.158817 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8397bc15-def4-404d-bb7e-916a33e057fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:26.192330 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-8397bc15-def4-404d-bb7e-916a33e057fe admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037448 Sep 19 11:50:26.192917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 7/12] 10.222.0.88 () {64 vars in 1336 bytes} [Mon Sep 19 11:50:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:28.937093 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-808c420c-ebc7-4397-a976-d16751ed2697 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:28.938200 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-808c420c-ebc7-4397-a976-d16751ed2697 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 19 11:50:28.938893 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 6/13] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:29.372937 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9b4e3e8f-e999-4f1a-94ce-e67620b95dfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "swap": 0}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:29.393016 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9b4e3e8f-e999-4f1a-94ce-e67620b95dfc admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446892 Sep 19 11:50:29.393568 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 8/14] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:29.407147 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-36f09cc2-8264-423f-94bf-e2f8a3804e64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:29.435945 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-36f09cc2-8264-423f-94bf-e2f8a3804e64 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033240 Sep 19 11:50:29.436537 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 7/15] 10.222.0.88 () {64 vars in 1336 bytes} [Mon Sep 19 11:50:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:32.145708 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9b4e3e8f-e999-4f1a-94ce-e67620b95dfc admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:32.146711 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9b4e3e8f-e999-4f1a-94ce-e67620b95dfc admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Sep 19 11:50:32.147289 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 9/16] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:50:32.631990 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c841b130-f2ea-4068-83d0-95ccfeffebd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:32.655484 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c841b130-f2ea-4068-83d0-95ccfeffebd9 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501477 Sep 19 11:50:32.656789 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 8/17] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:32.668721 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-afab2590-8f62-47d5-95d8-1d4d4e1c615d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:32.696784 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-afab2590-8f62-47d5-95d8-1d4d4e1c615d admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031491 Sep 19 11:50:32.697640 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 10/18] 10.222.0.88 () {64 vars in 1336 bytes} [Mon Sep 19 11:50:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:35.357335 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c841b130-f2ea-4068-83d0-95ccfeffebd9 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:35.358591 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c841b130-f2ea-4068-83d0-95ccfeffebd9 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001760 Sep 19 11:50:35.359113 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 9/19] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:35.831431 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-7003c149-b337-4bd7-b974-cf9f07740e2d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:35.857178 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-7003c149-b337-4bd7-b974-cf9f07740e2d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.490921 Sep 19 11:50:35.858355 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 11/20] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Sep 19 11:50:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:38.847490 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c841b130-f2ea-4068-83d0-95ccfeffebd9 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:38.848513 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c841b130-f2ea-4068-83d0-95ccfeffebd9 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 19 11:50:38.848920 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 10/21] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:39.282552 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-f11558e7-505f-4f12-a93f-e809d141a199 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "vcpus": 1, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:39.313294 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-f11558e7-505f-4f12-a93f-e809d141a199 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457911 Sep 19 11:50:39.313848 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 12/22] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:39.325872 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-d10f5171-0eaf-4370-b9f6-c1c8dcb2bf37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:39.356931 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-d10f5171-0eaf-4370-b9f6-c1c8dcb2bf37 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034722 Sep 19 11:50:39.357530 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 11/23] 10.222.0.88 () {64 vars in 1333 bytes} [Mon Sep 19 11:50:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:42.036425 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-f11558e7-505f-4f12-a93f-e809d141a199 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:42.037435 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-f11558e7-505f-4f12-a93f-e809d141a199 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 19 11:50:42.038058 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 13/24] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:42.454408 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-ea4063d3-9ce4-48d9-b0e7-faaedfb4b320 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "id": "2", "ram": 2048}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:42.478974 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-ea4063d3-9ce4-48d9-b0e7-faaedfb4b320 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433877 Sep 19 11:50:42.479679 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 12/25] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:50:42.493107 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-6844c465-561f-42ac-82db-30ea7a1dc064 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:42.520051 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-6844c465-561f-42ac-82db-30ea7a1dc064 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030588 Sep 19 11:50:42.520649 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 14/26] 10.222.0.88 () {64 vars in 1333 bytes} [Mon Sep 19 11:50:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:45.316913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-ea4063d3-9ce4-48d9-b0e7-faaedfb4b320 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:45.318010 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-ea4063d3-9ce4-48d9-b0e7-faaedfb4b320 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 19 11:50:45.318988 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 13/27] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:45.932829 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5d7f5677-44d0-4300-bf13-664d149574c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "disk": 40}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:45.955632 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5d7f5677-44d0-4300-bf13-664d149574c7 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.629650 Sep 19 11:50:45.956199 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 15/28] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:45.973611 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-0349b901-ecc0-46e8-8168-faed4074b7c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:45.979237 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:46.006523 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-0349b901-ecc0-46e8-8168-faed4074b7c9 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039791 Sep 19 11:50:46.007415 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 14/29] 10.222.0.88 () {64 vars in 1333 bytes} [Mon Sep 19 11:50:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:48.747293 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5d7f5677-44d0-4300-bf13-664d149574c7 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:48.748354 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5d7f5677-44d0-4300-bf13-664d149574c7 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 Sep 19 11:50:48.748785 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 16/30] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:49.202337 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-5259379b-0d6f-46b5-b909-0a755b32a54b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "id": "4", "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:49.229181 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-5259379b-0d6f-46b5-b909-0a755b32a54b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473563 Sep 19 11:50:49.229886 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 15/31] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:50:49.244101 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-4c4a3939-00e9-4a80-bb1b-f2a66ba09b8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:49.270082 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-4c4a3939-00e9-4a80-bb1b-f2a66ba09b8b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031056 Sep 19 11:50:49.271463 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 17/32] 10.222.0.88 () {64 vars in 1333 bytes} [Mon Sep 19 11:50:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:51.973060 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-5259379b-0d6f-46b5-b909-0a755b32a54b admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:51.975113 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-5259379b-0d6f-46b5-b909-0a755b32a54b admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002600 Sep 19 11:50:51.975901 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 16/33] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:50:52.454930 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-db244bd7-e741-4ed4-bf92-d42737d2980b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "swap": 0, "ram": 16384, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:52.464685 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:52.476155 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-db244bd7-e741-4ed4-bf92-d42737d2980b admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.493646 Sep 19 11:50:52.476937 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 18/34] 10.222.0.88 () {64 vars in 1283 bytes} [Mon Sep 19 11:50:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:50:52.489657 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-2ca93575-2beb-4484-b00a-0d5ace95ca8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:50:52.515752 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-2ca93575-2beb-4484-b00a-0d5ace95ca8f admin admin] 10.222.0.88 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029605 Sep 19 11:50:52.516342 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 17/35] 10.222.0.88 () {64 vars in 1333 bytes} [Mon Sep 19 11:50:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:08.672717 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-db244bd7-e741-4ed4-bf92-d42737d2980b admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:08.673638 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-db244bd7-e741-4ed4-bf92-d42737d2980b admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 19 11:51:08.674077 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 19/36] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:51:08.685157 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:09.202487 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-348dfaab-546c-431e-9a3f-f9434315c0db admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:09.221590 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-348dfaab-546c-431e-9a3f-f9434315c0db admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.540941 Sep 19 11:51:09.222171 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 18/37] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Sep 19 11:51:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:10.550631 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-db244bd7-e741-4ed4-bf92-d42737d2980b admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:10.551648 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-db244bd7-e741-4ed4-bf92-d42737d2980b admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 19 11:51:10.552106 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 20/38] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:51:11.071846 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-adeab512-f0ba-4a19-832d-1c4f4759680a admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:11.077126 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-adeab512-f0ba-4a19-832d-1c4f4759680a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-adeab512-f0ba-4a19-832d-1c4f4759680a admin admin] Request method failure captured: Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Accept: application/json Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Connection: keep-alive Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Content-Length: 0 Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Host: 10.222.0.88 Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.92 Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABjKFeuwC1EKbyOHMOancjNcc5598Kq6-4d_1QEgYKuivPXXXIfhuuytpN4akKiRGcxVpo_QrlqeOP25HaeD8GcM9e65M8_3MghVcdqtOcYoFHNnfAsqUqpomewdDdfgFVHVNKpp1qcJ9o8XH3LtGPLQxYfcPYZZTy9dFjfGdw2Ilj_h_w Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Role: member,reader,admin Sep 19 11:51:11.080695 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Roles: member,reader,admin Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a73ceb365cbe45598f5feb33f3998086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant: admin Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User: admin Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Id: e4f47c952a6a40bf944493656ebcef14 Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Name: admin Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: method: > Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: exception: Flavor 42 could not be found. Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: action_args: {'id': '42'} Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:51:11.082414 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:11.083476 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.084697 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-adeab512-f0ba-4a19-832d-1c4f4759680a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:51:11.085800 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-adeab512-f0ba-4a19-832d-1c4f4759680a admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392036 Sep 19 11:51:11.085800 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 19/39] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Sep 19 11:51:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:51:11.092372 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-40294d6a-9b6f-452f-b437-ffd708a5a01d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:11.115782 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-40294d6a-9b6f-452f-b437-ffd708a5a01d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027443 Sep 19 11:51:11.116327 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 21/40] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Sep 19 11:51:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:11.127026 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-6e0b57c5-19f3-406b-9eb8-9f924aacd7a1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:11.149820 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-6e0b57c5-19f3-406b-9eb8-9f924aacd7a1 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027324 Sep 19 11:51:11.150680 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 20/41] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Sep 19 11:51:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:11.161268 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9bbfcfca-8015-4f53-b2f8-d2af2be681ac admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:11.166731 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-9bbfcfca-8015-4f53-b2f8-d2af2be681ac admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9bbfcfca-8015-4f53-b2f8-d2af2be681ac admin admin] Request method failure captured: Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Accept: application/json Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Connection: keep-alive Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Content-Length: 0 Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Host: 10.222.0.88 Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjKFeuwC1EKbyOHMOancjNcc5598Kq6-4d_1QEgYKuivPXXXIfhuuytpN4akKiRGcxVpo_QrlqeOP25HaeD8GcM9e65M8_3MghVcdqtOcYoFHNnfAsqUqpomewdDdfgFVHVNKpp1qcJ9o8XH3LtGPLQxYfcPYZZTy9dFjfGdw2Ilj_h_w Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Role: member,reader,admin Sep 19 11:51:11.170046 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Roles: member,reader,admin Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a73ceb365cbe45598f5feb33f3998086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant: admin Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User: admin Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Id: e4f47c952a6a40bf944493656ebcef14 Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Name: admin Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: method: > Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: exception: Flavor 42 could not be found. Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: action_args: {'id': '42'} Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:51:11.171626 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:11.172797 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:11.174322 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-9bbfcfca-8015-4f53-b2f8-d2af2be681ac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:51:11.175619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-9bbfcfca-8015-4f53-b2f8-d2af2be681ac admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014555 Sep 19 11:51:11.175619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 22/42] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Sep 19 11:51:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:51:12.435655 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-6e0b57c5-19f3-406b-9eb8-9f924aacd7a1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:12.436667 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-6e0b57c5-19f3-406b-9eb8-9f924aacd7a1 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 19 11:51:12.437070 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 21/43] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:51:12.960557 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2aa68a64-e1e5-4201-bcdb-198304f18dea admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:12.965721 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-2aa68a64-e1e5-4201-bcdb-198304f18dea admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2aa68a64-e1e5-4201-bcdb-198304f18dea admin admin] Request method failure captured: Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Accept: application/json Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Connection: keep-alive Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Content-Length: 0 Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Host: 10.222.0.88 Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjKFew3z8HrPb8epRVcQc_2MafwSrJ_ntgiNLswH4bMVtKtuozEvkxLVjNl-yJ6574evYPtWVFD_JChQa8OWmGL1Vn1cCoRK6ct0FMCA0ZBNSuBlwUU6g-L1wY0OOAwKoXf8jA5N_HtQ85pQCSBQBVZhoQOPpVwHpVNMkx3udoBl2CSFo Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Role: member,reader,admin Sep 19 11:51:12.967917 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Roles: member,reader,admin Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a73ceb365cbe45598f5feb33f3998086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant: admin Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User: admin Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Id: e4f47c952a6a40bf944493656ebcef14 Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Name: admin Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: method: > Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: exception: Flavor 84 could not be found. Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: action_args: {'id': '84'} Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:51:12.969694 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:12.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:12.972404 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2aa68a64-e1e5-4201-bcdb-198304f18dea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:51:12.973855 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2aa68a64-e1e5-4201-bcdb-198304f18dea admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395434 Sep 19 11:51:12.973855 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 23/44] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Sep 19 11:51:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:51:12.979204 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-d85d4063-28dc-4ac9-b95c-1ba15aef8171 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:12.993874 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-d85d4063-28dc-4ac9-b95c-1ba15aef8171 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018221 Sep 19 11:51:12.994403 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 22/45] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Sep 19 11:51:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:13.004865 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-88f2bca9-50fa-48cd-848f-4bfbe819aaca admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:13.020642 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-88f2bca9-50fa-48cd-848f-4bfbe819aaca admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019897 Sep 19 11:51:13.021171 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 24/46] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Sep 19 11:51:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:13.030655 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-8ff093b3-3a13-42cb-93ff-c3662b93725d admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:13.035745 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-8ff093b3-3a13-42cb-93ff-c3662b93725d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-8ff093b3-3a13-42cb-93ff-c3662b93725d admin admin] Request method failure captured: Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Accept: application/json Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Connection: keep-alive Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Content-Length: 0 Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Host: 10.222.0.88 Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.92 Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABjKFew3z8HrPb8epRVcQc_2MafwSrJ_ntgiNLswH4bMVtKtuozEvkxLVjNl-yJ6574evYPtWVFD_JChQa8OWmGL1Vn1cCoRK6ct0FMCA0ZBNSuBlwUU6g-L1wY0OOAwKoXf8jA5N_HtQ85pQCSBQBVZhoQOPpVwHpVNMkx3udoBl2CSFo Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Role: member,reader,admin Sep 19 11:51:13.037251 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Roles: member,reader,admin Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a73ceb365cbe45598f5feb33f3998086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant: admin Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User: admin Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Id: e4f47c952a6a40bf944493656ebcef14 Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Name: admin Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: method: > Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: exception: Flavor 84 could not be found. Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: action_args: {'id': '84'} Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:51:13.038913 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:13.039847 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:13.041183 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-8ff093b3-3a13-42cb-93ff-c3662b93725d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:51:13.042541 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-8ff093b3-3a13-42cb-93ff-c3662b93725d admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011688 Sep 19 11:51:13.042541 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 23/47] 10.222.0.88 () {60 vars in 1190 bytes} [Mon Sep 19 11:51:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 11:51:14.284784 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-88f2bca9-50fa-48cd-848f-4bfbe819aaca admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:14.285813 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-88f2bca9-50fa-48cd-848f-4bfbe819aaca admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 19 11:51:14.286208 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 25/48] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:51:14.806229 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-da11f226-a5ef-40d3-bc70-58a7953b5031 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:14.812634 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-da11f226-a5ef-40d3-bc70-58a7953b5031 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-da11f226-a5ef-40d3-bc70-58a7953b5031 admin admin] Request method failure captured: Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Accept: application/json Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Connection: keep-alive Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Content-Length: 0 Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Host: 10.222.0.88 Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.92 Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABjKFeySqLkaa6oKupnh1Lju-koI9JPiZdXj5U7iTsyZsMfZEUBkjLC3DoJPwHc4mRymjWscqzuqSPKCel9AZXaqclJiGWON4pIetHQHfSoQrXsLZIZeTvmuToPXTFfp02QfJGyLLdxMnuYVu4Ebj4IQY4522jhk-0cH1OMQ6GrO8BMBr8 Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Role: member,reader,admin Sep 19 11:51:14.814182 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Roles: member,reader,admin Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a73ceb365cbe45598f5feb33f3998086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant: admin Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User: admin Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Id: e4f47c952a6a40bf944493656ebcef14 Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: X-User-Name: admin Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: method: > Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: exception: Flavor 451 could not be found. Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: action_args: {'id': '451'} Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:51:14.815724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:14.816573 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.817729 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-da11f226-a5ef-40d3-bc70-58a7953b5031 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:51:14.818993 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-da11f226-a5ef-40d3-bc70-58a7953b5031 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392835 Sep 19 11:51:14.818993 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 24/49] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Sep 19 11:51:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:51:14.825552 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b0327629-773d-4580-b21c-64bdc8efa872 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:14.842023 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-b0327629-773d-4580-b21c-64bdc8efa872 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019417 Sep 19 11:51:14.842023 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 26/50] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Sep 19 11:51:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:14.851752 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:14.866464 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] 10.222.0.88 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018291 Sep 19 11:51:14.866997 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 25/51] 10.222.0.88 () {60 vars in 1210 bytes} [Mon Sep 19 11:51:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:14.877054 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-536ac6ac-5d0f-4415-a7ef-8c796d488789 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:14.882106 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-536ac6ac-5d0f-4415-a7ef-8c796d488789 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-536ac6ac-5d0f-4415-a7ef-8c796d488789 admin admin] Request method failure captured: Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Accept: application/json Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Connection: keep-alive Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Content-Length: 0 Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Host: 10.222.0.88 Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.92 Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABjKFeySqLkaa6oKupnh1Lju-koI9JPiZdXj5U7iTsyZsMfZEUBkjLC3DoJPwHc4mRymjWscqzuqSPKCel9AZXaqclJiGWON4pIetHQHfSoQrXsLZIZeTvmuToPXTFfp02QfJGyLLdxMnuYVu4Ebj4IQY4522jhk-0cH1OMQ6GrO8BMBr8 Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Role: member,reader,admin Sep 19 11:51:14.883619 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Roles: member,reader,admin Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/a73ceb365cbe45598f5feb33f3998086"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_a73ceb365cbe45598f5feb33f3998086", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant: admin Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant-Id: a73ceb365cbe45598f5feb33f3998086 Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User: admin Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Id: e4f47c952a6a40bf944493656ebcef14 Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: X-User-Name: admin Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: method: > Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: exception: Flavor 451 could not be found. Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: action_args: {'id': '451'} Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:51:14.885217 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:14.886370 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Sep 19 11:51:14.887791 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-536ac6ac-5d0f-4415-a7ef-8c796d488789 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:51:14.889632 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-536ac6ac-5d0f-4415-a7ef-8c796d488789 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012044 Sep 19 11:51:14.889632 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 27/52] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Sep 19 11:51:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:51:16.133093 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:16.134237 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001635 Sep 19 11:51:16.134654 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 26/53] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:51:16.684883 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-bb5341af-420a-4aad-9c42-13d92302a187 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:51:16.705100 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-bb5341af-420a-4aad-9c42-13d92302a187 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.421267 Sep 19 11:51:16.705651 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 28/54] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Sep 19 11:51:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:51:17.945544 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:17.946584 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 19 11:51:17.946984 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 27/55] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:51:18.490921 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-df074b03-7655-4d92-bd7a-d506d4c5f5b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:51:18.509385 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-df074b03-7655-4d92-bd7a-d506d4c5f5b7 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.410133 Sep 19 11:51:18.509959 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 29/56] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Sep 19 11:51:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:51:19.747798 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:19.749469 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Sep 19 11:51:19.749896 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 28/57] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:51:20.290790 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-407cbc12-1745-4d45-8fca-cf0beb54a3a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:51:20.312036 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-407cbc12-1745-4d45-8fca-cf0beb54a3a4 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.425265 Sep 19 11:51:20.312758 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 30/58] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Sep 19 11:51:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:51:21.548472 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:21.549482 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 19 11:51:21.549917 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 29/59] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:51:22.090931 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-61a132c9-3e2d-4f08-8027-e15c2c3605a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:51:22.109453 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-61a132c9-3e2d-4f08-8027-e15c2c3605a9 admin admin] 10.222.0.88 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.423391 Sep 19 11:51:22.110145 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 31/60] 10.222.0.88 () {64 vars in 1235 bytes} [Mon Sep 19 11:51:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:51:23.339862 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:23.340879 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 19 11:51:23.341276 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 30/61] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:51:23.863631 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-602858c7-3696-4ac0-b088-734992f014fc admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:23.884407 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-602858c7-3696-4ac0-b088-734992f014fc admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405393 Sep 19 11:51:23.884956 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 32/62] 10.222.0.88 () {60 vars in 1202 bytes} [Mon Sep 19 11:51:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:52:21.408422 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:21.409452 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff2684c-ca09-4e11-9cff-ba55872b9d7f admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Sep 19 11:52:21.409871 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 31/63] 10.222.0.88 () {54 vars in 931 bytes} [Mon Sep 19 11:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:52:21.421023 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:21.922657 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-f6d6cb88-bafe-4829-9f49-37ee1fe56e48 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:21.943919 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-f6d6cb88-bafe-4829-9f49-37ee1fe56e48 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.527761 Sep 19 11:52:21.944395 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 33/64] 10.222.0.88 () {60 vars in 1292 bytes} [Mon Sep 19 11:52:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:21.965757 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=14 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:21.969748 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-6eeae086-d5f5-4340-9250-92fbcbf1c9ac admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:21.977280 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-6eeae086-d5f5-4340-9250-92fbcbf1c9ac admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012897 Sep 19 11:52:21.977858 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 32/65] 10.222.0.88 () {60 vars in 1283 bytes} [Mon Sep 19 11:52:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:21.990453 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-a26f6046-4d9e-482a-b534-45b82a233677 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:21.997843 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-a26f6046-4d9e-482a-b534-45b82a233677 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010978 Sep 19 11:52:21.998955 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 34/66] 10.222.0.88 () {60 vars in 1286 bytes} [Mon Sep 19 11:52:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:22.011892 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:22.019578 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012446 Sep 19 11:52:22.020117 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 33/67] 10.222.0.88 () {60 vars in 1286 bytes} [Mon Sep 19 11:52:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:22.032750 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5971f531-4235-4f5f-82f8-0c09dda683ef admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:22.040297 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5971f531-4235-4f5f-82f8-0c09dda683ef admin admin] 10.222.0.88 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011940 Sep 19 11:52:22.040846 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 35/68] 10.222.0.88 () {60 vars in 1283 bytes} [Mon Sep 19 11:52:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:55:26.240016 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:26.241034 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 19 11:55:26.241433 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 34/69] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:55:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:55:26.381061 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=6 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:26.541062 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:26.545700 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.546528 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.546641 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.547343 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.547784 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.548199 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.579930 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-a11293f2-5ab9-4efe-9538-f8d7d2c8c2c3 admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199935 Sep 19 11:55:26.580506 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 36/70] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Sep 19 11:55:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:55:27.697328 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:27.699644 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002291 Sep 19 11:55:27.700058 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 35/71] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:55:27.901559 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:27.905099 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.905516 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.905990 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.906703 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.907151 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.907567 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.927809 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-43a9cb31-aa40-41d7-9512-09e2486a9a6a admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083555 Sep 19 11:55:27.928360 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 37/72] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Sep 19 11:55:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:55:39.498724 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:39.499733 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 19 11:55:39.500137 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 36/73] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:55:39.642623 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:39.644057 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell1:SELECT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:39.644613 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=8 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:39.692509 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:39.695868 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:39.696366 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:39.696793 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:39.697517 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:39.697992 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:39.698403 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:39.724731 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-a7ccb63d-df96-47f3-ba16-dc5bd8d1a27f admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086359 Sep 19 11:55:39.725213 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 38/74] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Sep 19 11:55:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:40.811517 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:40.812521 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-099ba978-f4f8-4797-ae2e-40d1c76fd4c2 admin admin] 10.222.0.88 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 19 11:55:40.812956 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 37/75] 10.222.0.88 () {56 vars in 1074 bytes} [Mon Sep 19 11:55:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:55:41.008524 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:41.011892 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.012369 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.012794 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.013716 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.014186 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.014604 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.037017 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2692576a-95f8-4e9d-b5cb-7a042e0bef0e admin admin] 10.222.0.88 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080489 Sep 19 11:55:41.037576 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 39/76] 10.222.0.88 () {60 vars in 1193 bytes} [Mon Sep 19 11:55:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:38.839083 dv-cinder-858293-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 11:56:38.839662 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: Mon Sep 19 11:56:38 2022 - graceful shutdown triggered... Sep 19 11:56:38.840103 dv-cinder-858293-1-iscsi devstack@n-api.service[105410]: Gracefully killing worker 1 (pid: 105410)... Sep 19 11:56:38.840469 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: Gracefully killing worker 2 (pid: 105411)... Sep 19 11:56:38.966449 dv-cinder-858293-1-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=4 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:39.840649 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: worker 1 buried after 1 seconds Sep 19 11:56:39.841201 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: worker 2 buried after 1 seconds Sep 19 11:56:39.841201 dv-cinder-858293-1-iscsi devstack@n-api.service[105409]: goodbye to uWSGI. Sep 19 11:56:39.842218 dv-cinder-858293-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 11:56:39.842759 dv-cinder-858293-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 11:56:39.845551 dv-cinder-858293-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 11:56:39.857211 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:56:39 2022] *** Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: nodename: dv-cinder-858293-1-iscsi Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: machine: x86_64 Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: clock source: unix Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: pcre jit disabled Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: detected number of CPU cores: 4 Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: current working directory: / Sep 19 11:56:39.859646 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:56:39.860437 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: your processes number limit is 47680 Sep 19 11:56:39.860437 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: your memory page size is 4096 bytes Sep 19 11:56:39.860437 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: detected max file descriptor number: 2048 Sep 19 11:56:39.860437 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: lock engine: pthread robust mutexes Sep 19 11:56:39.860437 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: thunder lock: enabled Sep 19 11:56:39.860437 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 11:56:39.860437 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:56:39.900334 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: Python main interpreter initialized at 0x5587f41319c0 Sep 19 11:56:39.900334 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: python threads support enabled Sep 19 11:56:39.900334 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: your server socket listen backlog is limited to 100 connections Sep 19 11:56:39.900334 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:56:39.900846 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:56:39.900846 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: *** Operational MODE: preforking *** Sep 19 11:56:39.901055 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:56:39.901055 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: spawned uWSGI master process (pid: 120629) Sep 19 11:56:39.901262 dv-cinder-858293-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 11:56:39.905800 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: spawned uWSGI worker 1 (pid: 120643, cores: 1) Sep 19 11:56:39.905800 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: spawned uWSGI worker 2 (pid: 120644, cores: 1) Sep 19 11:56:39.905800 dv-cinder-858293-1-iscsi devstack@n-api.service[120629]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:56:40.584378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:56:40.608253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:56:41.773059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:56:41.773059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: from cryptography.utils import int_from_bytes Sep 19 11:56:41.773807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:56:41.773807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: from cryptography.utils import int_from_bytes Sep 19 11:56:41.777465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:56:41.777465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 19 11:56:41.778115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:56:41.778115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 19 11:56:44.324811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:56:44.325531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:56:44.325624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:56:44.326013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:56:44.326280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:56:44.326684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.327022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.327354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.327724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.328026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.328420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.328756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.329103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858293-1-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.334702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.335637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.335637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.335637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.335637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.335637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.335637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.336089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.336089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858293-1-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.340583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.341250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.341250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.341250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.341250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.341250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.341589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.341929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.342487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.342999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.343526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.344034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.344372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.344688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.345010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.345350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.345682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.346179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.346317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:56:44.346743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:56:44.346852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.347018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.347172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:56:44.347542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:56:44.347863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.347992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:56:44.348489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.348609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.348997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.349485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.349653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.350007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.350651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.351366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.351549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.351833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.352048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.352558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.353472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.355870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.356156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.356412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.356746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.357000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.357244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.357484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858293-1-iscsi {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.358972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.359201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.359458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.359748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.359998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.360189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.360357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.360506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.360506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.362466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.362622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.362771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.362939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.363138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.363305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.363481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.363635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.363779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.363923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.364085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.364238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.364389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.364541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.364685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.364858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.364858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.365157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.365157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.365451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.365594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.365744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.365744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.366060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.366214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.366370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.366370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.366678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858293-1-iscsi {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.366823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.366976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.367134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.367280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.367441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.367594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.367745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.367898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.368048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.368203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.368356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.368500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.368661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.368815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.368967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.369119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.369281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.369427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.369578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.369722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.369888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.370045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.370199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.370354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.370508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.370661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.371534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.371706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.371853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.372016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.373390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.373554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.373702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.373901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.374058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.374217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.374362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.374526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.374671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.374838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.374991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.375141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.375296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.375448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.375609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.375763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.375907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.376988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.377787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.377954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.378099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.378242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.378392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.378537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.378701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.378847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.379009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.379319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.379485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.379634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.379788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.379934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.380089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.380256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.380402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.380555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.380706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.380870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.381285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.381747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.381941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.382089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.382239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.382390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.382536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.382696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.88 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.382841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.382994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.88 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.383145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.383308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.383656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.383808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.383962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.384115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.384267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.384267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.384555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.384722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.384868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.384868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.385155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.385298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.385450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.385613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.385784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.385938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.386095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.386247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.386401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.386401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.386683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.386683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.386963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.387727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.387887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.388041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.388203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.388356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.388551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.388722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.388880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.389026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.389170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.389320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.389464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.389616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.389804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.389972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.389972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.390266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.390418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.390572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.390717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.390861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.391005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.391389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.391572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.392023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.392178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.392331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.392484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.392484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.392777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.392923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.393951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.394110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.394269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.394424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.394591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.394748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.394900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.395044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.395232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.395422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.395668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.395817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.396069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.396237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.396390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.396544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.396687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.396839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.396839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.397126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.397285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.397430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.397596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.397741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.397975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.398161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.398307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.398457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.398611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.398763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.398916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.399060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.399211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.399211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.399500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.399664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.399822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.399975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.400128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.400273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.400416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.400559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.401487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.401653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.402122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.402291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.402858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.403167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.403368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.403523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.403523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.403830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.404097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.404385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.404561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.404745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.404907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.405061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.405213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.405366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.405520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.405684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.405909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.406060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.406212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.406365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.406519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:56:44.406672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.406825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.406977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.407123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.407275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.407430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.407586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.407736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.407889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.408946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.409242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.409387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.409541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.409693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.409870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.410027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.410173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.410315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.410458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.410600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.410743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.410896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.411049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.411203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.411354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.411768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.411944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.412401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.412555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.412702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.412845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.412997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.413150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.413296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.413447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.413591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.413742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.413949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.414223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.414401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.414644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.414794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.414938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.415092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.415259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.415415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.415570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.415570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.415845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.415845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.416138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.416374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.416555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.416704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.416856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.417010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.417155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.417298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.417448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.417601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.417745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.417928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.418074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.418239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.418385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.418537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.418681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.418838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.418990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.419135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.419288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.419434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.419592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.419739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.419889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.420041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.420203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.420355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.420509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.420665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.420828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.421554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.421991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.422165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.422667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.422817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.422969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.423122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.423277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.423421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.423574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.423718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.423868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.424020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.424170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.424444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.424612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.424884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.425043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.425188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.425332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.425572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.425727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.425913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.426070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.426222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.426384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.426542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.426688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.426841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.426996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.427142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.427299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.427497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.427661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.427806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.427949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.428110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.428261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.428422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.428574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.428726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.428885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.429047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.429212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.429373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.429524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.429690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.429921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.430126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.430299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.430460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.430611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.430769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.430930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.431082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.431244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.431396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.431554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.431723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.432145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.432334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.432823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.432985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.433143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.433296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.433296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.433608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.433797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.434156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.434319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.434499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.434776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.435066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.435304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.435471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.435624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.435774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.435924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.436089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.436241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.436400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.436559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.436711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.436898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.437075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.437235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.437402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.437555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.437705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.437899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.438052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.438202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.438352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.438516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.438668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.438827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.438985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.439155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.439307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.439464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.439623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.440276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.440441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.440593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.440751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.440902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.441061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.441226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.441378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.441527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.441696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.441909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.442321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.442483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.442976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.443141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.443302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.443454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.443615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.443778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.443930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.444089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.444262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.444423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.445345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.445519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.445672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.445846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.446023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.446185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.446346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.446507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.446668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.446819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.446978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.447152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.447304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.447462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.447612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.447770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.447922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.448081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.448241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.448392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.448550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.448710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.448868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.449030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.449204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.449356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.449514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.449664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.449854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.450025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.450178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.450336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.450502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.450654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.450804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.450983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.451974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.452180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.452598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.452769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.453261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.453431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.453585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.453736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.453938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.454092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.454254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.454414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.454565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.454734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.456177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.456346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.456511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.456664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.456823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.456984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.457135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.457285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.457446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.457599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.457749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.457973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.458140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.458305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.458467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.458627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.458779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.458938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.459096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.459264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.459264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.459603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.459759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.459918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.460070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.460241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.460241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.460540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.460690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.460840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.460990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.461223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.461378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.461541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.461541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.461931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.462096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.462247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.462708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.463484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.463658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.463820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.463986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.464138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.464303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.464455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.464613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.464773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.464936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.465094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.465254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.465416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.465711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.465985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.466157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.466312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.466471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.466471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.466767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.466928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.467080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.467230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.467470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.467651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.467806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.467966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.467966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.468262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.468414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.468581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.468741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.468959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.469129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.469290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.469451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.469609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.469797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.469971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.470126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.470284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.470446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.470599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.470757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.470916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.471608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.471773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.471940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.472094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.472252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.472413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.472818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.472992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.473162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.473624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.473803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.473963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.474116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.474284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.474439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.474590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.474740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.474891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.475053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.475214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.475368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.475526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.475703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.475947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.476207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.476379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.476533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.476533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.476820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.476978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.477137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.477314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.477476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.477635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.477846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.478020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.478189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.478344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.478502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.478654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.478812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.478981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.479277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.479469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.479635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.479789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.479939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.480098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.480264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.480425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.480577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.480728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.480892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.481050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.481212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.481364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.481527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.481704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.481894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.482049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.482208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.482361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.482512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.482690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.483083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.483244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.483414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.483861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.484022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.484199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.484352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.484503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.484662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.484814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.484974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.485127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.485284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.485449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.485602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.485754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.485960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.486246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.486513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.486728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.486890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.487043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.487239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.487393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.487544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.487695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.487695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.488000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.488163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.488323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.488498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.488650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.488809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.488974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.489134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.489286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.489437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.489586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.489737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.489944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.490099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.490257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.490435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.490600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.490760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.490923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.491076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.491226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.491384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.491537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.491729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.491900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.492062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.492214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.492364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.492528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.492700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.492861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.493234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.493394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.493555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.494019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.494192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.494347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.494497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.494497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.494793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.494943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.495184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.495348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.495507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.495659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.495809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.495959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.496124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.496387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.496680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.496840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.496992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.497153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.497306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.497477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.497637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.497814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.498164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.498335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.498496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.498649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.498807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.498966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.499126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.499289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.499450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.499603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.499778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.499940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.500092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.500253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.500414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.500575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.500736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.500896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.501058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.501212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.501363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.501522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.501522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.501849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.502024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.502185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.502883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.503044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.503420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.503581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.503830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.504266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.504429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.504591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.504751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.504910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.505089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.505242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.505402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.505402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.505402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.505402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.506089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.506255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.506425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.506692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.506692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.507099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.507271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.507430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.507590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.507749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.507909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.508075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.508228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.508386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.508539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.508696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.508857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.509023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.509183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.509344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.509494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.509644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.509831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.509989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.510141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.510300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.510460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.510611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.510771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.510923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.511082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.516555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.516788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.516973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.517154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.517314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.517477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.517631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.517808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.518028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.518200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.518364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.518535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.518689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.518849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.519027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.519183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.519335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.519487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.519637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.519797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.519959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.520113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.520264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.520425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.520586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.520747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.520925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.521080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.521080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.521386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.521539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.521712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.521948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.522115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.522275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.522437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.522598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.522759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.522912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.523083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.523236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.523415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.523605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.523819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.523986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.524156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.524358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.524516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.524668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.524833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.524987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.525933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.526988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.527971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.528940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.529909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.530965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.531975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.532976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.534256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.534412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.534412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.534698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.534855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.535004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.535159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.535460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.535633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.535809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.535979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.536120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.536255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.536389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.536532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.536668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.536802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.536934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.537077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.537212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.537356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.537500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.537635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.537794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.537930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.538064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.538217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.538353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.538487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.538639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.538782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.538916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.539065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.539214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.539349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.539489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.539636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.539780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.539917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.540050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.540192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.540326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.540459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.540602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.540746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.540881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.541023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.541157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.541298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.541446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.541588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.541729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.541884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.542032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.542167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.542312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.542454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.542596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.542731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.542854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.543005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.543149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.543294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.543430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.543571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.543713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.543861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.544991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.545252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.545400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.545671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.545826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.545974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.546109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.546242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.546390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.546535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.546671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.546804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.546937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.547940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.548076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.548200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.548305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.548435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.548542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.548687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.548822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.549928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.550700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.551993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.552984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.553984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.554119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.554119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.554388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.554531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.554531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.554800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.554943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.555087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.555229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.555371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.555505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.555505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.555899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.556838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.557203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.558662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.559483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.560177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.560177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.560177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.560177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.560177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.560814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.560932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.561882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.562879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.563940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.564244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.564350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.564448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.564545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.564635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.565268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.565409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.565511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.565616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.565758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.565903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.566044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.566206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.566365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.566365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.566622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.566769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.566926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.567901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.568991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.569968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.570090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.570183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.570288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.570463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.570574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.570784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.570924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.571085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.571198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.571410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.571508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.571730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.572063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.572439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.572771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.573094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.573283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.573458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.573610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.573781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.573990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.574289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.574461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.574618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.574780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.574949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.575105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.575282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.575448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.575617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.575852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.576008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.577084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.577084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.577084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.577472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.577587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.577747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.577894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.578084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.578298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.578419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.578543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.578721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.578861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.579060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.579216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.579363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.579542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.579682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.579879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.579991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.580204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.580309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.580587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.580709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.580922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.581034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.581244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.581341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.581638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.581854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.582192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.582323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.582545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.582683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.582891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.582987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.583232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.583339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.583566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.583669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.583886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.583982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.584220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.584326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.584537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.584643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.584853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.584958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.585173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.585277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.585490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.585584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.585828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.585941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.586147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.586241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.586457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.586601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.586773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.586920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.587087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.587260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.587414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.587562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.587718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.588128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.588271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.588412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.588569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.588711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.588870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.589012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.589174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.589308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.589492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.589634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.589868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.589974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.590132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.590300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.590445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.590629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.590745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.590945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.591046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.591269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.591365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.591585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.591758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.591920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.592071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.592268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.592372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.592603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.592712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.592934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.593042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.593247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.593345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.593557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.593663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.593900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.594013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.594219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.594325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.594545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.594642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.594857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.594964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.595166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.595263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.595474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.595627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.595786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.595967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.596690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.596861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.597067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.597204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.597338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.597514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.597659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.597852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.598038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.598145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.598369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.598467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.598711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.598818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.599040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.599136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.599347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.599455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.599654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.599762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.599963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.600059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.600269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.600364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.600577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.600675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.600884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.600981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.601190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.601287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.601496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.601601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.601856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.601972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.602192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.602289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.602510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.602608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.602826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.602923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.603140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.603253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.603457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.603554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.603771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.603867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.604085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.604194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.604402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.604501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.604718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.604824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.605031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.605136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.605373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.605515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.605691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.605857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.606034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.606187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.606350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.606500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.606736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.606854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.606982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.607136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.607281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.607450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.607615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.607945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.608078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.608256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.608381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.608584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.608688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.608909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.609162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.609324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.609476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.609636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.609810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.609966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.610065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.610180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.610373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.610495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.610696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.610803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.611021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.611119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.611336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.611479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.611722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.611926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.612111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.612254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.612382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.612518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.612661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.612855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.612988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.613175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.613315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.613536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.613647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.613978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.614077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.614312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.614592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.614691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.614920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.615085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.615232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.615548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.615699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.615871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.616107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.616212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.616479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.616651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.616863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.617100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.617225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.617408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.617681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.617857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.618035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.618219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.618325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.618639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.618735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.618944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.619252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.619358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.619558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.619768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.619874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.620138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:56:44.620247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.620448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.620762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.621067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.621374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.621678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.622010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.622316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.622654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.622993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.623317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.623644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.623957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.624286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.624600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.624925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.625251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.625573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.625918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.626253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.626654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.626985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.627850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.628089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.628403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.628716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.629047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.629377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.629687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.630045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.630402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.630684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.631005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.631317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.631650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.631964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.632276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.632588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.632902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.633215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.633634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.633945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.634263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.634585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.634907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.635238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.635569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.635882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.636210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.636542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.637151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.637277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.637672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.638095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.638494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.638819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.639131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:56:44.639381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:56:44.694727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Registered counter for database nova_api Sep 19 11:56:44.708058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Registered counter for database nova_api Sep 19 11:56:44.718106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.727005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:44.731049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.737640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:44.784523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.context [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da7f277f-e3d5-498c-9c41-09e6e3516152(cell1) {{(pid=120644) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:56:44.788545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:44.789021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:44.790651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:44.791373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:44.791823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:44.793836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:44.793983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.context [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da7f277f-e3d5-498c-9c41-09e6e3516152(cell1) {{(pid=120643) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:56:44.795847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Registered counter for database nova_cell0 Sep 19 11:56:44.798094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:44.798578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:44.800440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Registered counter for database nova_cell1 Sep 19 11:56:44.801616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:44.802723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:44.803180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:44.805207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:44.807319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Registered counter for database nova_cell0 Sep 19 11:56:44.808327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.809554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.811629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Registered counter for database nova_cell1 Sep 19 11:56:44.817618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:44.817985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:44.819488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.822036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.826636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:44.833346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:44.967931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO dbcounter [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Registered counter for database nova_cell0 Sep 19 11:56:44.976039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_db.sqlalchemy.engines [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.981171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writer thread running {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:44.982006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Registered counter for database nova_cell0 Sep 19 11:56:44.989555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:56:44.996912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:56:45.304370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:56:45.311799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:56:45.329806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:56:45.339654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:56:45.665180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:56:45.671813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: WARNING keystonemiddleware.auth_token [None req-db09932c-1c2b-4905-88b8-bdf61ae06910 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:56:45.677896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587f41319c0 pid: 120644 (default app) Sep 19 11:56:45.685079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:56:45.691528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-575cd03d-efd7-4fe7-8f3e-fbe0c3e73880 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:56:45.696814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587f41319c0 pid: 120643 (default app) Sep 19 11:57:20.937268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:20.938175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:20.939903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:20.940730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:22.067285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8221f7b4-6d3c-41d5-acad-dae844097903 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Action: 'create', calling method: .version_select at 0x7f4ff70fd4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-518130020"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:24.085398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8221f7b4-6d3c-41d5-acad-dae844097903 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.169951 Sep 19 11:57:24.086485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1/1] 10.222.0.88 () {60 vars in 1155 bytes} [Mon Sep 19 11:57:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3172 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 11:57:24.341972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e156196-d0c1-401c-aac2-4da88e46f04a tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6fcf3a0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:24.437027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1e156196-d0c1-401c-aac2-4da88e46f04a tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/59dc7bbc-4383-4b5e-9334-3bf246b9b843" status: 200 len: 350 microversion: 2.1 time: 0.100217 Sep 19 11:57:24.446608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 2/2] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:24 2022] GET /compute/v2.1/os-volumes/59dc7bbc-4383-4b5e-9334-3bf246b9b843 => generated 350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:57:24.638801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c362fe9-d7f4-4746-9919-c93de36d12c1 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff7187af0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:24.741834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.743273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.745040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:24.746377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:25.285264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c362fe9-d7f4-4746-9919-c93de36d12c1 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 200 len: 345 microversion: 2.1 time: 1.183247 Sep 19 11:57:25.286177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1/3] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:24 2022] GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 345 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:25.302525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4d068b57-dfd4-4c40-a6d7-c78a88146cc3 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Action: 'create', calling method: .version_select at 0x7f4ff6fcfa60>, body: {"snapshot": {"volume_id": "d8fc2458-4f4f-4086-9d15-83cc86b005a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1951793067"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:25.989539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4d068b57-dfd4-4c40-a6d7-c78a88146cc3 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.692313 Sep 19 11:57:25.996191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 3/4] 10.222.0.88 () {60 vars in 1162 bytes} [Mon Sep 19 11:57:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:26.009333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8600d040-db26-4206-bf27-8a466a821083 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fa9430>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:26.175444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8600d040-db26-4206-bf27-8a466a821083 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 200 len: 287 microversion: 2.1 time: 0.176669 Sep 19 11:57:26.176240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2/5] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Sep 19 11:57:25 2022] GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 287 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:26.188526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d5dab80c-b467-441e-9457-c1745bdf8e3d tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6f66c10>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:26.217505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f3c822f-0dd6-4b25-b58f-2c4d4049ed87 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6fa94c0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:26.252120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d5dab80c-b467-441e-9457-c1745bdf8e3d tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.067450 Sep 19 11:57:26.253043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 4/6] 10.222.0.88 () {58 vars in 1140 bytes} [Mon Sep 19 11:57:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:26.266089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c01767b5-cf98-4346-beb6-a194d72d1df3 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff70fdee0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:26.341581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f3c822f-0dd6-4b25-b58f-2c4d4049ed87 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/8981d4ab-b263-4630-a6b5-661bc0b7d21f" status: 200 len: 350 microversion: 2.1 time: 0.128190 Sep 19 11:57:26.342635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 3/7] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:26 2022] GET /compute/v2.1/os-volumes/8981d4ab-b263-4630-a6b5-661bc0b7d21f => generated 350 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:26.384041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c01767b5-cf98-4346-beb6-a194d72d1df3 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 200 len: 287 microversion: 2.1 time: 0.122985 Sep 19 11:57:26.384603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 5/8] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Sep 19 11:57:26 2022] GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:57:27.398416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5dfeb766-e74b-463c-af26-c449ebad3a53 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fa9b80>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:27.457537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5dfeb766-e74b-463c-af26-c449ebad3a53 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 200 len: 287 microversion: 2.1 time: 0.063256 Sep 19 11:57:27.462989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 4/9] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Sep 19 11:57:27 2022] GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:28.475345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a2d7c80-254b-4931-9c16-833d962b2f8a tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fcf9d0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:28.533116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a2d7c80-254b-4931-9c16-833d962b2f8a tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 200 len: 287 microversion: 2.1 time: 0.060954 Sep 19 11:57:28.533858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 6/10] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Sep 19 11:57:28 2022] GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:29.546331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e0655f1-e945-4c77-9cb6-6598d97cab4a tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fcb310>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:29.629993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e0655f1-e945-4c77-9cb6-6598d97cab4a tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 200 len: 288 microversion: 2.1 time: 0.087451 Sep 19 11:57:29.630757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 5/11] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Sep 19 11:57:29 2022] GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:29.644325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da20d0f3-5a01-4b8f-846f-68a78eef424e tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fcf280>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:29.803305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da20d0f3-5a01-4b8f-846f-68a78eef424e tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "DELETE /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 202 len: 0 microversion: 2.1 time: 0.163854 Sep 19 11:57:29.804681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 7/12] 10.222.0.88 () {58 vars in 1254 bytes} [Mon Sep 19 11:57:29 2022] DELETE /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:57:29.828462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61f0c28b-b973-4a8b-be74-5cc015f53fc6 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fcb9d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:29.940121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61f0c28b-b973-4a8b-be74-5cc015f53fc6 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 200 len: 287 microversion: 2.1 time: 0.130608 Sep 19 11:57:29.940681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 6/13] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Sep 19 11:57:29 2022] GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:30.307918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-54cf08a2-f761-4947-9dfe-010a6a6a684d tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6fcf940>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:30.413607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-54cf08a2-f761-4947-9dfe-010a6a6a684d tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/e960c21a-9ba9-4cea-aff0-131861fbb531" status: 200 len: 351 microversion: 2.1 time: 0.109438 Sep 19 11:57:30.414338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 8/14] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:30 2022] GET /compute/v2.1/os-volumes/e960c21a-9ba9-4cea-aff0-131861fbb531 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:30.429445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24bc1824-f919-462e-9ccf-5497e9815c86 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6fa9dc0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:30.759249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24bc1824-f919-462e-9ccf-5497e9815c86 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.333551 Sep 19 11:57:30.760634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 7/15] 10.222.0.88 () {58 vars in 1134 bytes} [Mon Sep 19 11:57:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:30.776081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8fa6efb2-4e6c-463f-a166-43e44c66de2c tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff792a790>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:30.952709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c147c249-a6bd-4842-8587-0b43b94edeaa tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fa9700>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.094560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-c147c249-a6bd-4842-8587-0b43b94edeaa tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] HTTP exception thrown: Snapshot a8492431-d18c-4076-9751-bb3796150a1c could not be found. Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c147c249-a6bd-4842-8587-0b43b94edeaa tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Request method failure captured: Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c HTTP/1.1 Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkggkoycGvG7Yrpb9SqNymF101jZlTzpQ2JQ7PSHlqK4hl90eGprfbcJGmi2DS7kjvXbSPHoS2bRG9b5BYLwZGh1iV4a_NNVd56KcE_xxRMOrpyiUUk6Huax6LLHES8D_d4gmRlFgov9yV__rbq2-Mo738uynWevkJ-iE83knLx6gI Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:31.099645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_02d3b2d4d255495f91e42bf4c39a41a7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f6e2d26fb24a4ec88cd54088f1150e96 Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Snapshot a8492431-d18c-4076-9751-bb3796150a1c could not be found. Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'a8492431-d18c-4076-9751-bb3796150a1c'} Sep 19 11:57:31.100769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a8492431-d18c-4076-9751-bb3796150a1c could not be found. (HTTP 404) (Request-ID: req-648b65b8-02d9-4b6f-8121-f47e6969e5d7) Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:31.101433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:31.102459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a8492431-d18c-4076-9751-bb3796150a1c could not be found. Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 11:57:31.103387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a8492431-d18c-4076-9751-bb3796150a1c could not be found. Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a8492431-d18c-4076-9751-bb3796150a1c could not be found. Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c147c249-a6bd-4842-8587-0b43b94edeaa tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Returning 404 to user: Snapshot a8492431-d18c-4076-9751-bb3796150a1c could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c147c249-a6bd-4842-8587-0b43b94edeaa tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c" status: 404 len: 111 microversion: 2.1 time: 0.152615 Sep 19 11:57:31.104445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 8/16] 10.222.0.88 () {58 vars in 1251 bytes} [Mon Sep 19 11:57:30 2022] GET /compute/v2.1/os-snapshots/a8492431-d18c-4076-9751-bb3796150a1c => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 11:57:31.121811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8fa6efb2-4e6c-463f-a166-43e44c66de2c tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.349428 Sep 19 11:57:31.122709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 9/17] 10.222.0.88 () {58 vars in 1149 bytes} [Mon Sep 19 11:57:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:31.134016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dde7d866-6e30-4c86-b737-b7aa051eaa0d tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff792b9d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.154368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dead4f66-3a49-4b22-b23f-82e58f4fc180 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6f66c10>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.323241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dde7d866-6e30-4c86-b737-b7aa051eaa0d tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 202 len: 0 microversion: 2.1 time: 0.216630 Sep 19 11:57:31.324051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 9/18] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 11:57:31 2022] DELETE /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:57:31.335978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da36a6da-3a8a-44f5-8f0c-e475b34acfab tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fa9670>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.340335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dead4f66-3a49-4b22-b23f-82e58f4fc180 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.189726 Sep 19 11:57:31.341159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 10/19] 10.222.0.88 () {58 vars in 1134 bytes} [Mon Sep 19 11:57:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:31.357499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4389b229-3367-4f0f-81f3-9cf4e41ba8f6 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6f668b0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.467525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da36a6da-3a8a-44f5-8f0c-e475b34acfab tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 200 len: 344 microversion: 2.1 time: 0.137174 Sep 19 11:57:31.468268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 10/20] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:31 2022] GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:31.482617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4389b229-3367-4f0f-81f3-9cf4e41ba8f6 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.130287 Sep 19 11:57:31.483815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 11/21] 10.222.0.88 () {58 vars in 1167 bytes} [Mon Sep 19 11:57:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:31.498997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-905791fa-7391-475c-89f1-c79802f54c96 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6f61430>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.678429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-905791fa-7391-475c-89f1-c79802f54c96 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.183268 Sep 19 11:57:31.679300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 11/22] 10.222.0.88 () {58 vars in 1170 bytes} [Mon Sep 19 11:57:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:31.696125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c79e27c4-8039-43e6-80b3-f74724727bf2 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6fcfee0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.911937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c79e27c4-8039-43e6-80b3-f74724727bf2 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.219312 Sep 19 11:57:31.912594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 12/23] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Sep 19 11:57:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:31.926758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad27fea2-3b16-473c-a44a-6bd93b852ef6 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6fdb700>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:32.142489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad27fea2-3b16-473c-a44a-6bd93b852ef6 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.219663 Sep 19 11:57:32.143061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 12/24] 10.222.0.88 () {58 vars in 1188 bytes} [Mon Sep 19 11:57:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:32.164268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a8939bd-a774-4453-beca-c0e0dc9b6607 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] Calling method '.version_select at 0x7f4ff6f6ddc0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:32.368295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a8939bd-a774-4453-beca-c0e0dc9b6607 tempest-VolumesTestJSON-738028573 tempest-VolumesTestJSON-738028573-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.209064 Sep 19 11:57:32.369212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 13/25] 10.222.0.88 () {58 vars in 1155 bytes} [Mon Sep 19 11:57:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:32.483499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87bc4538-0d4a-414b-90ab-9486f89e5778 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fdb9d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:32.615725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87bc4538-0d4a-414b-90ab-9486f89e5778 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 200 len: 344 microversion: 2.1 time: 0.137938 Sep 19 11:57:32.623515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 13/26] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:32 2022] GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:33.634728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a672fcc-f8ad-4fce-be39-e1dcdbfc2227 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fcf820>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:33.808794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a672fcc-f8ad-4fce-be39-e1dcdbfc2227 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 200 len: 344 microversion: 2.1 time: 0.169166 Sep 19 11:57:33.808794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 14/27] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:33 2022] GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:34.812103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b28b946f-9cad-427e-a972-cd84c62b11c5 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fdb0d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:34.896425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-b28b946f-9cad-427e-a972-cd84c62b11c5 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] HTTP exception thrown: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b28b946f-9cad-427e-a972-cd84c62b11c5 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Request method failure captured: Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 HTTP/1.1 Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkggkoycGvG7Yrpb9SqNymF101jZlTzpQ2JQ7PSHlqK4hl90eGprfbcJGmi2DS7kjvXbSPHoS2bRG9b5BYLwZGh1iV4a_NNVd56KcE_xxRMOrpyiUUk6Huax6LLHES8D_d4gmRlFgov9yV__rbq2-Mo738uynWevkJ-iE83knLx6gI Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:34.899160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_02d3b2d4d255495f91e42bf4c39a41a7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f6e2d26fb24a4ec88cd54088f1150e96 Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'd8fc2458-4f4f-4086-9d15-83cc86b005a7'} Sep 19 11:57:34.900537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. (HTTP 404) (Request-ID: req-69b9c0a3-13fc-40b5-bca9-1be0e4909594) Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:34.901238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:34.902267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:57:34.903255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:34.904154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:34.906768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b28b946f-9cad-427e-a972-cd84c62b11c5 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Returning 404 to user: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:34.909373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b28b946f-9cad-427e-a972-cd84c62b11c5 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 404 len: 109 microversion: 2.1 time: 0.100634 Sep 19 11:57:34.910208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 14/28] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:34 2022] GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:34.924130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ba6ea76-214d-4234-b7e1-797c38feab89 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fcf430>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:35.090328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-8ba6ea76-214d-4234-b7e1-797c38feab89 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] HTTP exception thrown: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ba6ea76-214d-4234-b7e1-797c38feab89 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Request method failure captured: Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 HTTP/1.1 Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFkggkoycGvG7Yrpb9SqNymF101jZlTzpQ2JQ7PSHlqK4hl90eGprfbcJGmi2DS7kjvXbSPHoS2bRG9b5BYLwZGh1iV4a_NNVd56KcE_xxRMOrpyiUUk6Huax6LLHES8D_d4gmRlFgov9yV__rbq2-Mo738uynWevkJ-iE83knLx6gI Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 11:57:35.095338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_02d3b2d4d255495f91e42bf4c39a41a7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f6e2d26fb24a4ec88cd54088f1150e96 Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'd8fc2458-4f4f-4086-9d15-83cc86b005a7'} Sep 19 11:57:35.096673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. (HTTP 404) (Request-ID: req-34e2e898-8e0a-4787-af41-a00b01a4b220) Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:35.097485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:57:35.098692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:57:35.099847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.101842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ba6ea76-214d-4234-b7e1-797c38feab89 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Returning 404 to user: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:35.103098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ba6ea76-214d-4234-b7e1-797c38feab89 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 404 len: 109 microversion: 2.1 time: 0.181691 Sep 19 11:57:35.110868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 15/29] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 11:57:34 2022] DELETE /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:35.119497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb9f945d-c55c-4b50-a817-5d0715080d70 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Calling method '.version_select at 0x7f4ff6fdbf70>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:35.229366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-eb9f945d-c55c-4b50-a817-5d0715080d70 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] HTTP exception thrown: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb9f945d-c55c-4b50-a817-5d0715080d70 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Request method failure captured: Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 HTTP/1.1 Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkggkoycGvG7Yrpb9SqNymF101jZlTzpQ2JQ7PSHlqK4hl90eGprfbcJGmi2DS7kjvXbSPHoS2bRG9b5BYLwZGh1iV4a_NNVd56KcE_xxRMOrpyiUUk6Huax6LLHES8D_d4gmRlFgov9yV__rbq2-Mo738uynWevkJ-iE83knLx6gI Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:35.231532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/02d3b2d4d255495f91e42bf4c39a41a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_02d3b2d4d255495f91e42bf4c39a41a7", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 02d3b2d4d255495f91e42bf4c39a41a7 Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-861788698 Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f6e2d26fb24a4ec88cd54088f1150e96 Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-861788698-project Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'd8fc2458-4f4f-4086-9d15-83cc86b005a7'} Sep 19 11:57:35.232859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. (HTTP 404) (Request-ID: req-57561071-855e-4752-8135-35bc46c2d21f) Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:35.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:35.234561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:57:35.240032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb9f945d-c55c-4b50-a817-5d0715080d70 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] Returning 404 to user: Volume d8fc2458-4f4f-4086-9d15-83cc86b005a7 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb9f945d-c55c-4b50-a817-5d0715080d70 tempest-VolumesSnapshotsTestJSON-861788698 tempest-VolumesSnapshotsTestJSON-861788698-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7" status: 404 len: 109 microversion: 2.1 time: 0.119667 Sep 19 11:57:35.243227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 15/30] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:35 2022] GET /compute/v2.1/os-volumes/d8fc2458-4f4f-4086-9d15-83cc86b005a7 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:36.397357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee12a26c-7ec9-4f59-9101-1a9b6f98cabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'create', calling method: .version_select at 0x7f4ff6fcfee0>, body: {"keypair": {"name": "tempest-keypair-1333976459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzNcMaHRSgodfO75eX4y2+9yryHfNQbcq9H6Mcx0/swVhMykieaC0l/OYDUZIx8QurGKE8RehYa/cn0ikcVORvYCbY3hX/5fP3e1SWBfsgaUybZRpZ2b4w3VDJhAX0V+g=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:36.577298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-ee12a26c-7ec9-4f59-9101-1a9b6f98cabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for project ec6875fa35a4462698c06020a0238285. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:36.595860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-ee12a26c-7ec9-4f59-9101-1a9b6f98cabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for user 8fa4b6af47384c7fb26aae3547d02b64 and project ec6875fa35a4462698c06020a0238285. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:36.742438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee12a26c-7ec9-4f59-9101-1a9b6f98cabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.943962 Sep 19 11:57:36.743684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 16/31] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 11:57:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:40.180869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-983728638", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:40.428686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] validate_networks() for [('0267ab88-2ebf-4472-8b38-39eacc9e993a', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:57:43.461954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-557394847", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54da1265-89c0-4c3d-9625-41afb5c2e57a"}], "security_groups": [{"name": "tempest-securitygroup--604551807"}], "key_name": "tempest-keypair-1333976459", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:44.053833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] validate_networks() for [('54da1265-89c0-4c3d-9625-41afb5c2e57a', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:57:44.057598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:57:44.058157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:57:44.058962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:57:44.059540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:57:44.060106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:57:44.098593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:44.102871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:44.104565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:44.106747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:44.107730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:44.109644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:44.191805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:44.210876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for user 11af9e7e3fed4bea9187dee0ebf27551 and project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:44.257323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:57:44.264354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:57:44.481626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e927602-46e1-43a7-b75d-55075f23cbd4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.075653 Sep 19 11:57:44.492336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 16/32] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 11:57:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 5092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:57:45.154877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1fb0d44-79bf-47bb-ab16-f72c7ddc8648 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'create', calling method: .version_select at 0x7f4ff6e531f0>, body: {"keypair": {"name": "tempest-keypair-1994989413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3buxoCUP2P/UOtmtHapRW37m6KK+T2i3zgMzKxiL8tfsmKXscrBmAudzK+d4sS8GX0n2RYxhwo3D1Xm9i4QcheQtYfa6KaeW/EyFMBGDrqcGQla5o0OrbEJZLZ/Vf8SQ=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:45.221722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-a1fb0d44-79bf-47bb-ab16-f72c7ddc8648 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for project 256ccce56c534cacb247aa128399f3f1. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:45.234163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-a1fb0d44-79bf-47bb-ab16-f72c7ddc8648 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for user 766511b86ad643c099998fc4e1638f9a and project 256ccce56c534cacb247aa128399f3f1. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:45.322308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1fb0d44-79bf-47bb-ab16-f72c7ddc8648 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.827922 Sep 19 11:57:45.324425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 17/33] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Sep 19 11:57:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 831 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 11:57:45.630600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-692974330", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "networks": [{"uuid": "25ca1b87-caed-4bb5-ba9d-831df21044c3"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:45.770295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] validate_networks() for [('25ca1b87-caed-4bb5-ba9d-831df21044c3', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:57:46.637422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:46.704728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:57:46.705182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:57:46.706208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:57:46.706868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:57:46.707530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:57:46.736400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:46.737259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:46.739026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:46.740700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:46.743385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:46.744077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:46.812065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for project ec6875fa35a4462698c06020a0238285. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:46.834349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for user 8fa4b6af47384c7fb26aae3547d02b64 and project ec6875fa35a4462698c06020a0238285. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:46.857111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:57:46.861669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:57:46.974096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-230a2295-f2fa-4f1f-9112-dbc8c6803980 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.520183 Sep 19 11:57:46.976570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 17/34] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 11:57:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 3524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 11:57:46.976878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:57:46.977583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:57:46.978131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:57:46.978554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:57:46.978971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:57:46.986182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:46.987683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:47.008689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:47.010577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:47.011306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:47.013030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:47.013987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:47.014655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:47.023556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:47.024057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:47.024590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:47.025326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:47.026546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:47.030966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:47.106783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Getting quotas for project ced3cefcaf434541a38dd01270076279. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:47.118986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Getting quotas for user 1015b24d41f446069b0e0884b92a1772 and project ced3cefcaf434541a38dd01270076279. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:47.160503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:57:47.168491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:57:47.264892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6b93ce6-6b21-43c5-9161-ee49e1989212 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938800 Sep 19 11:57:47.265540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 18/35] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 11:57:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:57:47.470628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:47.498220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-72e82f16-c796-43be-81a5-d7abbc2f685c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1225 microversion: 2.1 time: 0.512217 Sep 19 11:57:47.499077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 18/36] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:46 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1225 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:47.513630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ccdc930b-1130-4873-a588-ff9e44e0efd2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:47.514629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ccdc930b-1130-4873-a588-ff9e44e0efd2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:47.717528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd3ed464-1220-4680-9e44-151292d5899a tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Action: 'create', calling method: .version_select at 0x7f4ff65f00d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1481763929", "metadata": {"Type": "work"}}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd3ed464-1220-4680-9e44-151292d5899a tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Request method failure captured: Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 122 Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk4gIYJCs9qnrxMcDkbvUjdoCOgDjwQPi9ufttvf8NN2P2_gyYD3xbBR-j5F3Kwz3V0WqohbQgdazvP4mVtMTQnewMmjm6DFlpHmKzWELjrhqlrBDj7qc-hLCVir5GI_a8baAKEliCA89_lr182muMxG0MLo26GPJbASyQNNdK9nOk Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:47.734160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7869613d45064c3e9b07fd3d41183637", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 10fba9b80ee2408aa916add7397b3348 Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1481763929", "metadata": {"Type": "work"}}} Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:47.735672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1481763929', 'metadata': {'Type': 'work'}}}} Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:47.736557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:57:47.738029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:57:47.739159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:57:47.739159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:47.741818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd3ed464-1220-4680-9e44-151292d5899a tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:47.746059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd3ed464-1220-4680-9e44-151292d5899a tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.477864 Sep 19 11:57:47.747107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 19/37] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Sep 19 11:57:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 481 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:57:47.783852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09bdf1d9-4686-492b-a390-6c79cfcd01bc tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:47.785323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09bdf1d9-4686-492b-a390-6c79cfcd01bc tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:48.101430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ccdc930b-1130-4873-a588-ff9e44e0efd2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:48.137319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ccdc930b-1130-4873-a588-ff9e44e0efd2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1237 microversion: 2.1 time: 0.635971 Sep 19 11:57:48.138201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 19/38] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1237 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:48.170606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93889486-6e6b-4d98-bb4a-583d20b7c480 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Action: 'create', calling method: .version_select at 0x7f4ff659ad30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1248728239", "metadata": {"Type": "work"}}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93889486-6e6b-4d98-bb4a-583d20b7c480 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Request method failure captured: Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 120 Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFk4gIYJCs9qnrxMcDkbvUjdoCOgDjwQPi9ufttvf8NN2P2_gyYD3xbBR-j5F3Kwz3V0WqohbQgdazvP4mVtMTQnewMmjm6DFlpHmKzWELjrhqlrBDj7qc-hLCVir5GI_a8baAKEliCA89_lr182muMxG0MLo26GPJbASyQNNdK9nOk Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 11:57:48.177141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7869613d45064c3e9b07fd3d41183637", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 10fba9b80ee2408aa916add7397b3348 Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1248728239", "metadata": {"Type": "work"}}} Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: Sep 19 11:57:48.178453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1248728239', 'metadata': {'Type': 'work'}}}} Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi '0' Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:48.179243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:57:48.181243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:57:48.183326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:57:48.183326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.185053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93889486-6e6b-4d98-bb4a-583d20b7c480 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:48.186434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93889486-6e6b-4d98-bb4a-583d20b7c480 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020563 Sep 19 11:57:48.187839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 20/39] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Sep 19 11:57:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:57:48.194418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-38802510", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:48.217111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09bdf1d9-4686-492b-a390-6c79cfcd01bc tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:48.260531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09bdf1d9-4686-492b-a390-6c79cfcd01bc tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1214 microversion: 2.1 time: 0.511013 Sep 19 11:57:48.263758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 20/40] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:47 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1214 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:48.270950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] validate_networks() for [('0267ab88-2ebf-4472-8b38-39eacc9e993a', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:57:48.298703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef32176b-6ba8-48b2-a280-645a3c313bac tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Action: 'create', calling method: .version_select at 0x7f4ff6e5d0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-318273527", "metadata": {"Type": "work"}}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef32176b-6ba8-48b2-a280-645a3c313bac tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Request method failure captured: Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 118 Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk4gIYJCs9qnrxMcDkbvUjdoCOgDjwQPi9ufttvf8NN2P2_gyYD3xbBR-j5F3Kwz3V0WqohbQgdazvP4mVtMTQnewMmjm6DFlpHmKzWELjrhqlrBDj7qc-hLCVir5GI_a8baAKEliCA89_lr182muMxG0MLo26GPJbASyQNNdK9nOk Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:48.314709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7869613d45064c3e9b07fd3d41183637", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 10fba9b80ee2408aa916add7397b3348 Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-318273527", "metadata": {"Type": "work"}}} Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:48.315991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-318273527', 'metadata': {'Type': 'work'}}}} Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi '' Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:48.316749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:57:48.317912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:57:48.318910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:57:48.318910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.318910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef32176b-6ba8-48b2-a280-645a3c313bac tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:48.319099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef32176b-6ba8-48b2-a280-645a3c313bac tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.054159 Sep 19 11:57:48.338287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 21/41] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Sep 19 11:57:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:57:48.357715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad3fdaaf-866c-4a81-8b81-adabbd220aab tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Calling method '.version_select at 0x7f4ff65d90d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:48.425219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-ad3fdaaf-866c-4a81-8b81-adabbd220aab tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] HTTP exception thrown: Volume tempest-invalid-442462050 could not be found. Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad3fdaaf-866c-4a81-8b81-adabbd220aab tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Request method failure captured: Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-442462050 HTTP/1.1 Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk4gIYJCs9qnrxMcDkbvUjdoCOgDjwQPi9ufttvf8NN2P2_gyYD3xbBR-j5F3Kwz3V0WqohbQgdazvP4mVtMTQnewMmjm6DFlpHmKzWELjrhqlrBDj7qc-hLCVir5GI_a8baAKEliCA89_lr182muMxG0MLo26GPJbASyQNNdK9nOk Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:48.427401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7869613d45064c3e9b07fd3d41183637", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 10fba9b80ee2408aa916add7397b3348 Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Volume tempest-invalid-442462050 could not be found. Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'tempest-invalid-442462050'} Sep 19 11:57:48.428932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-442462050 could not be found. (HTTP 404) (Request-ID: req-9d24dbb0-da1e-46e7-941e-eee0243fb39a) Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.429622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:57:48.430723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-442462050 could not be found. Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:48.431660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-442462050 could not be found. Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-442462050 could not be found. Sep 19 11:57:48.432860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.436889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad3fdaaf-866c-4a81-8b81-adabbd220aab tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Returning 404 to user: Volume tempest-invalid-442462050 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:48.438021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad3fdaaf-866c-4a81-8b81-adabbd220aab tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/tempest-invalid-442462050" status: 404 len: 98 microversion: 2.1 time: 0.094548 Sep 19 11:57:48.438768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 22/42] 10.222.0.88 () {58 vars in 1215 bytes} [Mon Sep 19 11:57:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-442462050 => generated 98 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:57:48.451603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b47063c-47fc-4e42-8a33-ab1b0c676ffc tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007351 Sep 19 11:57:48.452967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 23/43] 10.222.0.88 () {58 vars in 1140 bytes} [Mon Sep 19 11:57:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 11:57:48.472480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03ad0f6a-3c87-4475-90b2-f0d049b3362e tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009168 Sep 19 11:57:48.473078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 24/44] 10.222.0.88 () {58 vars in 1137 bytes} [Mon Sep 19 11:57:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 11:57:48.489724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6428055b-0e06-4a92-88a2-abdffc19d493 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Calling method '.version_select at 0x7f4ff65fdb80>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:48.572699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-6428055b-0e06-4a92-88a2-abdffc19d493 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] HTTP exception thrown: Volume 6f895261-bec9-4992-a12f-d318b4b7d8a9 could not be found. Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6428055b-0e06-4a92-88a2-abdffc19d493 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Request method failure captured: Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/6f895261-bec9-4992-a12f-d318b4b7d8a9 HTTP/1.1 Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk4gIYJCs9qnrxMcDkbvUjdoCOgDjwQPi9ufttvf8NN2P2_gyYD3xbBR-j5F3Kwz3V0WqohbQgdazvP4mVtMTQnewMmjm6DFlpHmKzWELjrhqlrBDj7qc-hLCVir5GI_a8baAKEliCA89_lr182muMxG0MLo26GPJbASyQNNdK9nOk Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:48.574905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7869613d45064c3e9b07fd3d41183637", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 10fba9b80ee2408aa916add7397b3348 Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Volume 6f895261-bec9-4992-a12f-d318b4b7d8a9 could not be found. Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '6f895261-bec9-4992-a12f-d318b4b7d8a9'} Sep 19 11:57:48.576111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f895261-bec9-4992-a12f-d318b4b7d8a9 could not be found. (HTTP 404) (Request-ID: req-7ed2a631-0008-4dfb-893f-97ed5a7fd6c7) Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.576900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:57:48.579508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f895261-bec9-4992-a12f-d318b4b7d8a9 could not be found. Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:57:48.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f895261-bec9-4992-a12f-d318b4b7d8a9 could not be found. Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f895261-bec9-4992-a12f-d318b4b7d8a9 could not be found. Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6428055b-0e06-4a92-88a2-abdffc19d493 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Returning 404 to user: Volume 6f895261-bec9-4992-a12f-d318b4b7d8a9 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6428055b-0e06-4a92-88a2-abdffc19d493 tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "DELETE /compute/v2.1/os-volumes/6f895261-bec9-4992-a12f-d318b4b7d8a9" status: 404 len: 109 microversion: 2.1 time: 0.093919 Sep 19 11:57:48.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 25/45] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 11:57:48 2022] DELETE /compute/v2.1/os-volumes/6f895261-bec9-4992-a12f-d318b4b7d8a9 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:48.591978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e35844a-3447-4ae1-92a1-253f4cbf1c5b tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Calling method '.version_select at 0x7f4ff65fdd30>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:48.703143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-5e35844a-3447-4ae1-92a1-253f4cbf1c5b tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] HTTP exception thrown: Volume 6c637a08-8364-49d5-8db2-de6f121f473b could not be found. Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e35844a-3447-4ae1-92a1-253f4cbf1c5b tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Request method failure captured: Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-volumes/6c637a08-8364-49d5-8db2-de6f121f473b HTTP/1.1 Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk4gIYJCs9qnrxMcDkbvUjdoCOgDjwQPi9ufttvf8NN2P2_gyYD3xbBR-j5F3Kwz3V0WqohbQgdazvP4mVtMTQnewMmjm6DFlpHmKzWELjrhqlrBDj7qc-hLCVir5GI_a8baAKEliCA89_lr182muMxG0MLo26GPJbASyQNNdK9nOk Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:57:48.706846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/7869613d45064c3e9b07fd3d41183637"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_7869613d45064c3e9b07fd3d41183637", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 7869613d45064c3e9b07fd3d41183637 Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-927634199 Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 10fba9b80ee2408aa916add7397b3348 Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-927634199-project Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Volume 6c637a08-8364-49d5-8db2-de6f121f473b could not be found. Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '6c637a08-8364-49d5-8db2-de6f121f473b'} Sep 19 11:57:48.708362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c637a08-8364-49d5-8db2-de6f121f473b could not be found. (HTTP 404) (Request-ID: req-18af4997-c5ea-48d3-8408-55548ce4650f) Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.709245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:57:48.711027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c637a08-8364-49d5-8db2-de6f121f473b could not be found. Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:57:48.712296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c637a08-8364-49d5-8db2-de6f121f473b could not be found. Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c637a08-8364-49d5-8db2-de6f121f473b could not be found. Sep 19 11:57:48.713959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:57:48.716374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e35844a-3447-4ae1-92a1-253f4cbf1c5b tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] Returning 404 to user: Volume 6c637a08-8364-49d5-8db2-de6f121f473b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:48.717423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e35844a-3447-4ae1-92a1-253f4cbf1c5b tempest-VolumesNegativeTest-927634199 tempest-VolumesNegativeTest-927634199-project] 10.222.0.88 "GET /compute/v2.1/os-volumes/6c637a08-8364-49d5-8db2-de6f121f473b" status: 404 len: 109 microversion: 2.1 time: 0.130384 Sep 19 11:57:48.718539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 26/46] 10.222.0.88 () {58 vars in 1245 bytes} [Mon Sep 19 11:57:48 2022] GET /compute/v2.1/os-volumes/6c637a08-8364-49d5-8db2-de6f121f473b => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:49.182192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:49.183056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:49.190649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:49.197300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:49.197916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:49.201663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:49.202431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:49.203110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:49.478244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:49.499527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c465e32-b0cc-4890-8fe2-39e1fbfc0e07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1241 microversion: 2.1 time: 0.324442 Sep 19 11:57:49.500121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 27/47] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1241 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:49.514431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:49.514935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:49.521904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:49.522408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:49.522861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:49.523588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:49.524045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:49.524491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:49.554728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:57:49.556585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:57:49.557246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:57:49.558486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:57:49.559084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:57:49.571107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:49.571849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:49.573103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:49.574107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:49.574769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:49.575423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:49.603842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:49.609173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for user 11af9e7e3fed4bea9187dee0ebf27551 and project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:49.623528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:49.627370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:57:49.631470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:57:49.632951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-552c5271-a753-475c-9650-f89f3a4df31b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1218 microversion: 2.1 time: 0.126003 Sep 19 11:57:49.633530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 28/48] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:49 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:49.713187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59cbd88e-0524-461b-bf8b-15503303bf75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.522553 Sep 19 11:57:49.716256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 21/49] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 11:57:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:57:49.728164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f974f8d2-98a9-4558-92fb-eaccabcb6341 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:49.728882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f974f8d2-98a9-4558-92fb-eaccabcb6341 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:49.867888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f974f8d2-98a9-4558-92fb-eaccabcb6341 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:49.877334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f974f8d2-98a9-4558-92fb-eaccabcb6341 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1220 microversion: 2.1 time: 0.152934 Sep 19 11:57:49.906109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 29/50] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:49 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:50.484978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-838141117", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1cff81ad-d456-41a4-b3b7-0f85405c64ec"}], "security_groups": [{"name": "tempest-securitygroup--238675593"}], "key_name": "tempest-keypair-1994989413", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:50.528485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:50.529112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:50.536464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:50.547068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:50.548167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:50.551427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:50.556071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:50.560070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:50.824205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:50.839372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a16a42d-1520-43a2-91c6-da4f61be6232 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1233 microversion: 2.1 time: 0.315250 Sep 19 11:57:50.843765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 30/51] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1233 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:50.857206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:50.858133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:50.866733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] validate_networks() for [('1cff81ad-d456-41a4-b3b7-0f85405c64ec', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:57:50.908673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:50.910636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:50.913910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:50.914911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:50.917255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:50.918621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:51.154527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:51.171813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a4753c4-fe0e-421d-9501-1c3ddca78c16 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1210 microversion: 2.1 time: 0.324747 Sep 19 11:57:51.177426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 31/52] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:50 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1210 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:51.221680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:51.228917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:51.250255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:51.250822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:51.258828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:51.261693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:51.265871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:51.270028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:51.533933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:51.573750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d493f78a-f7c1-4188-9bdb-3306eeb900f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1216 microversion: 2.1 time: 0.393130 Sep 19 11:57:51.575087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 32/53] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:51 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1216 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:51.872258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:51.873215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:51.883608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:51.886426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:51.904287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:51.905391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:51.910210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:51.913320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:52.120389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:57:52.121505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:57:52.122315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:57:52.122967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:57:52.123834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:57:52.151347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:52.152071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:52.153712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:52.156175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:52.158325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:52.159056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:52.207435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for project 256ccce56c534cacb247aa128399f3f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:52.219123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for user 766511b86ad643c099998fc4e1638f9a and project 256ccce56c534cacb247aa128399f3f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:52.230552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:52.250665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4777878-7b14-46ad-9386-cca94b4402da tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1289 microversion: 2.1 time: 0.379673 Sep 19 11:57:52.253630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 33/54] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1289 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:57:52.267462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:52.268727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:52.278930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:57:52.284056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:57:52.285808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:52.291353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:52.293605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:52.295146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:52.301409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:52.302811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:52.521938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1331be79-418a-4aad-bb48-69ee1989212c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.041779 Sep 19 11:57:52.529688 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 22/55] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Sep 19 11:57:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 11:57:52.550502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:52.551563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8228ea23-cdba-468e-b03b-1d35e89e4186 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:52.552209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8228ea23-cdba-468e-b03b-1d35e89e4186 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:52.567189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2392759-f46a-44c6-96cd-b17c376c0108 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1266 microversion: 2.1 time: 0.308618 Sep 19 11:57:52.569330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 34/56] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:52 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:52.613654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:52.615631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:52.661672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:52.669428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:52.675033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:52.683097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:52.685393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:52.692560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:52.722335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8228ea23-cdba-468e-b03b-1d35e89e4186 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:52.752552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8228ea23-cdba-468e-b03b-1d35e89e4186 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:52.758402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8228ea23-cdba-468e-b03b-1d35e89e4186 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:52.761363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8228ea23-cdba-468e-b03b-1d35e89e4186 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1281 microversion: 2.20 time: 0.224416 Sep 19 11:57:52.763635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 23/57] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:57:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1281 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:57:52.931127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:52.945667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30a076b8-8a0a-4587-9070-9e4d3ab20882 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1216 microversion: 2.1 time: 0.345981 Sep 19 11:57:52.946726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 35/58] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:52 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1216 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:53.283394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:53.284490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:53.302452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:53.303661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:53.304285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:53.310280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:53.311035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:53.321018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:53.500197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:53.517694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3df5094d-db23-440e-b166-9727b6b3ea31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.241432 Sep 19 11:57:53.521798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 24/59] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:53.600978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:53.602145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:53.623589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:53.624154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:53.626632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:53.628535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:53.631055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:53.631876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:53.749025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:53.767231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fddfef40-b5f0-4f0b-9ea4-b9cf3df0e182 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1266 microversion: 2.1 time: 0.175764 Sep 19 11:57:53.767972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 36/60] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:53 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:53.794723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:53.796489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:53.846845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:53.857616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:53.861162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:53.865687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:53.866678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:53.868531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:53.974692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:53.982665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:53.999611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:54.000977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:54.003208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:54.003982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:54.004454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:54.005873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:54.006563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:54.025986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:54.027349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:54.028859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-afc0a9a7-b11e-475d-8620-6c734ce04e5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1285 microversion: 2.20 time: 0.241717 Sep 19 11:57:54.029750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 25/61] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:57:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1285 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:57:54.138007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:54.151086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3cf222f-1e89-4038-b2fe-cd2ba6367ba9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1216 microversion: 2.1 time: 0.178460 Sep 19 11:57:54.152020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 37/62] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:53 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:57:54.549420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:54.550084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:54.558967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:54.559475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:54.559936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:54.560731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:54.561109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:54.561833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:54.628991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:54.637098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56ee1c57-5a63-48e7-a692-f5bee6ccdfd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.092300 Sep 19 11:57:54.637606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 26/63] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:54.791273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:54.791847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:54.798413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:54.798880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:54.799413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:54.800133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:54.800866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:54.800997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:54.864392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:54.872589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-480e77ff-a3ba-4e9f-809d-097891421f36 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1266 microversion: 2.1 time: 0.085357 Sep 19 11:57:54.873172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 38/64] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:54 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:55.056856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:55.057626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:55.064744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.065253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.065713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:55.070893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.070893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.070893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:55.135515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:55.146857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:55.150860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:55.152074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-730ddf0e-abaa-48a5-a390-19542534993a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1285 microversion: 2.20 time: 0.099397 Sep 19 11:57:55.153202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 27/65] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:57:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:57:55.176683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:55.177927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:55.185609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.186128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.186568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:55.187276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.187761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.188723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:55.254835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:55.262841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90adf675-9c51-4cdb-8989-131705bc45b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1216 microversion: 2.1 time: 0.092279 Sep 19 11:57:55.263411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 39/66] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:55 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1216 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:57:55.661309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:55.662842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:55.669640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.670484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.670998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:55.671784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.673058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.673741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:55.784634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:55.799920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfd7fa16-9c8b-4b34-ada3-6dbe4186a373 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.143239 Sep 19 11:57:55.801519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 28/67] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:55.899466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:55.900315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:55.907110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.907874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.908590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:55.909554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:55.910225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:55.910721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:56.010008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:56.025354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ee26cbe-427a-4058-b953-ba1b8aebcb61 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1266 microversion: 2.1 time: 0.130311 Sep 19 11:57:56.026398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 40/68] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:55 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:56.177457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:56.178645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:56.185515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:56.186373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:56.187281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:56.189046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:56.189803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:56.190471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:56.270582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:56.287796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:56.289268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:56.290414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-402274e4-11be-4517-bd7f-54aea98e00cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1285 microversion: 2.20 time: 0.117259 Sep 19 11:57:56.305489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 29/69] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:57:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:57:56.305704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:56.305704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:56.305704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:56.305704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:56.306104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:56.306104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:56.306104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:56.306104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:56.410755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:56.419218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f02aa816-c225-4a23-9d88-0ddc3c61dc44 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1216 microversion: 2.1 time: 0.134689 Sep 19 11:57:56.420123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 41/70] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:56 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:56.837467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:56.838194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:56.847608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:56.848145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:56.848937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:56.850007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:56.850715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:56.851361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:56.958514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:56.968357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-be0f42dc-c17a-499b-9883-070cd68c4d82 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.135023 Sep 19 11:57:56.969912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 30/71] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:57.056586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:57.061183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:57.061183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:57.074443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:57.075025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:57.075533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:57.076505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:57.077184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:57.077885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:57.178431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:57.187999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94d47d60-eeee-4199-ba82-2e3c0fba310c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1266 microversion: 2.1 time: 0.136913 Sep 19 11:57:57.204545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 42/72] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:57 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:57.321719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:57.323074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:57.332794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:57.333492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:57.334120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:57.335693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:57.336573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:57.337333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:57.424917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:57.438379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:57.441519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:57.443591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-613f6af7-148d-4a0d-9ee7-abb18ec38f36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1285 microversion: 2.20 time: 0.126627 Sep 19 11:57:57.444586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 31/73] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:57:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:57:57.452978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:57.454684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:57.465217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:57.466185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:57.467051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:57.468541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:57.469497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:57.470357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:57.553019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:57.557975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:57.566639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05dc95b7-959a-4362-850e-d2fd4944dc41 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1216 microversion: 2.1 time: 0.125855 Sep 19 11:57:57.567918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 43/74] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:57 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1216 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:58.010463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:58.012157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:58.029424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.030549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.031281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.033526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.034698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.035427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.165451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:58.181539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ac344c8-feba-4faa-ab51-65bb7179c3f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.181652 Sep 19 11:57:58.181999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 32/75] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:58.215281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:58.216632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:58.225466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.225995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.226427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.227336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.227748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.228173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.314795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:58.325346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-005ad02e-b40a-4b4c-9136-bd93a666280b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1266 microversion: 2.1 time: 0.114381 Sep 19 11:57:58.326121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 44/76] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:58 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:57:58.475980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:58.481606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:58.491161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.491921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.492569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.496837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.497335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.498069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.589458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:58.592448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:58.593139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:58.600501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:58.602070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:58.602423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.602900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.603336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e9063157-cceb-4c34-93c4-0d002a926d3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1285 microversion: 2.20 time: 0.134467 Sep 19 11:57:58.603544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.613535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 33/77] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:57:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:57:58.613712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:58.613712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:58.613712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:58.692878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:58.705741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8c9aa38-6421-4951-9bb7-96320622f7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1216 microversion: 2.1 time: 0.117441 Sep 19 11:57:58.707233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 45/78] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:58 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:57:59.209059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:59.210748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:59.228944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.229353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.229658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.230665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.231146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.231943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.349911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:59.351186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:59.362929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.364618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.365508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.367965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.370070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.370733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.406206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:59.455728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45a4f6b4-a1ef-4a36-96a2-a321e547e209 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.246656 Sep 19 11:57:59.460223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 34/79] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:59.642892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:59.646835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:59.677263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:59.683067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.689472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.691290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.692945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.693631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6b1cf4f-66ae-413a-8a28-37a2569bd331 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1266 microversion: 2.1 time: 0.348191 Sep 19 11:57:59.696096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.697481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.716413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 46/80] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:59 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:59.763290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:59.764332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:59.819883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.823079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.823699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.833615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:59.837313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:59.842309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:59.882958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:59.950820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:59.958678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:59.959851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-03874986-4c7a-412d-aa04-c2e6150ea6f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1285 microversion: 2.20 time: 0.333504 Sep 19 11:57:59.966525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 35/81] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:57:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1285 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:57:59.981786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=20 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:00.148087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:00.170471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf410194-8984-46f2-b9db-a2b082bf09a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1272 microversion: 2.1 time: 0.434029 Sep 19 11:58:00.174258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 47/82] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:59 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1272 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:00.489604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:00.491025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:00.499315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:00.502749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:00.503824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:00.505031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:00.506380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:00.508043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:00.509163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:00.704745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:00.722795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e0decf0-7d42-42be-a907-314964b5863f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.238796 Sep 19 11:58:00.725756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:00.726527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:00.736865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 36/83] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:00.739382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:00.741674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:00.742232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:00.743043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:00.744732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:00.749062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:00.995078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:00.996214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:01.032807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:01.035092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:01.037367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:01.039993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:01.043595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:01.046276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:01.425706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:01.451555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:01.461368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:01.463313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49ed55b9-9092-49f4-902f-0188b0e0284c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1277 microversion: 2.20 time: 0.474572 Sep 19 11:58:01.469355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 37/84] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1277 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:58:01.507710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:01.525439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:01.550927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:01.564694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:01.567929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:01.586915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:01.591055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:01.596958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:01.685348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:01.712773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:01.727585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d40168c1-ace0-4d4a-bcca-ed012f3d4bce tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1272 microversion: 2.1 time: 1.002233 Sep 19 11:58:01.730298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 48/85] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:00 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1272 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:01.771378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:01.774466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:01.807458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:01.814413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:01.814413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:01.815881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:01.826959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:01.827938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:01.934790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:01.962774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-11b2de0a-4bab-4a29-9453-9a84f0f0ff59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1280 microversion: 2.1 time: 0.468547 Sep 19 11:58:01.963379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 38/86] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:01 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1280 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:02.022644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:02.056971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-643d5913-a495-448e-a9a9-14574d07a1fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1295 microversion: 2.1 time: 0.295923 Sep 19 11:58:02.058182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 49/87] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1295 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:02.505314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:02.506002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:02.516747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.523341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:02.524806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:02.526158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:02.528977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:02.530177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:02.532701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:02.738996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=22 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:02.764901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:02.767575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:02.785646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:02.786572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:02.787281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:02.788360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:02.794449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:02.795278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:03.091584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:03.102425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:03.119723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:03.121098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b011df4f-a1d0-4c57-9a2b-a7abd8a4ec27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1333 microversion: 2.20 time: 0.620809 Sep 19 11:58:03.146661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 39/88] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1333 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:03.182822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:03.183449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:03.196381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:03.196861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:03.197364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:03.198090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:03.198558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:03.199046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:03.271497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:03.288703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98c0b2fe-ef76-4d37-9414-5f44ec71f38c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1272 microversion: 2.1 time: 0.527590 Sep 19 11:58:03.289711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 50/89] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:02 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1272 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:03.303408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:03.304341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:03.348730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:03.352221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:03.352786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:03.353239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:03.366205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:03.367133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:03.373319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:03.575371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:03.598540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-90fa7158-ab7b-4c51-86d0-8bfa2b250a7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1278 microversion: 2.1 time: 0.450387 Sep 19 11:58:03.622532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 40/90] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:03 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1278 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:04.158461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:04.159084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:04.174376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:04.174988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:04.175519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:04.176243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:04.176737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:04.177163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:04.414494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:04.448250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:04.451470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:04.453222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-006761e9-1d36-4263-996f-eb511f34018b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1339 microversion: 2.20 time: 0.299464 Sep 19 11:58:04.454948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 41/91] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1339 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:04.474898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:04.477366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:04.488021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:04.489275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:04.490358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:04.491845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:04.492800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:04.493616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:04.673575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:04.690158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4044fbc4-614b-40eb-a688-7d0b7dbf0507 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 1.399195 Sep 19 11:58:04.696162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 51/92] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:04.720192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:04.721447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:04.733783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:04.737021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:04.752567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:04.758293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:04.759326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:04.762541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:05.212734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:05.266300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40ab3c56-dcb0-4f29-ab37-9ae766942cb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1278 microversion: 2.1 time: 0.564796 Sep 19 11:58:05.271856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 52/93] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:04 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1278 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:05.493536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:05.494451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:05.511563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:05.512954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:05.519401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:05.523252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:05.523942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:05.524768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:05.655450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:05.667084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74dcb723-17b1-4166-9d19-9c832a565843 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 1.210420 Sep 19 11:58:05.667667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 42/94] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:04 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:05.733181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:05.734585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:05.751381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:05.752223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:05.753649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:05.756620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:05.757317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:05.757954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:05.898507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:05.912836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:05.917124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:05.923355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2afdc5b2-d04e-460c-955e-192fd9804539 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1339 microversion: 2.20 time: 0.433948 Sep 19 11:58:05.924264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 53/95] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1339 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:06.295234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:06.296566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:06.323829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:06.329547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:06.330818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:06.342005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:06.343913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:06.347474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:06.481405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:06.506829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51413648-5c68-432c-bc45-9e6c2f3107f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.778522 Sep 19 11:58:06.509793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 43/96] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:06.558977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:06.569557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a72f6ba7-181d-4647-a50a-45b50126587f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1278 microversion: 2.1 time: 0.282183 Sep 19 11:58:06.586028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 54/97] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:06 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1278 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:06.636308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-3f34d1cd-099c-445f-bba0-81a1f8f622fd req-606407cf-85a9-4757-9392-2a34e826573a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88", "tag": "60e4df69-30ab-4bd6-8f47-3dc96227847c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:06.665069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3f34d1cd-099c-445f-bba0-81a1f8f622fd req-606407cf-85a9-4757-9392-2a34e826573a service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:06.666212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3f34d1cd-099c-445f-bba0-81a1f8f622fd req-606407cf-85a9-4757-9392-2a34e826573a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:06.666634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3f34d1cd-099c-445f-bba0-81a1f8f622fd req-606407cf-85a9-4757-9392-2a34e826573a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:06.708140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-3f34d1cd-099c-445f-bba0-81a1f8f622fd req-606407cf-85a9-4757-9392-2a34e826573a service nova] Creating event network-changed:60e4df69-30ab-4bd6-8f47-3dc96227847c for instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 on hv-cinder-85829 Sep 19 11:58:06.711008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3f34d1cd-099c-445f-bba0-81a1f8f622fd req-606407cf-85a9-4757-9392-2a34e826573a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120644) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 11:58:06.712491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3f34d1cd-099c-445f-bba0-81a1f8f622fd req-606407cf-85a9-4757-9392-2a34e826573a service nova] Acquired lock "compute-rpcapi-router" {{(pid=120644) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 11:58:06.715399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:06.717074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:06.718353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:06.720394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:06.721423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:06.722131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:06.725782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:06.728503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:06.754172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.compute.rpcapi [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 11:58:06.756465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] Releasing lock "compute-rpcapi-router" {{(pid=120644) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 11:58:06.757454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:06.758298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:06.759067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:06.760282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:06.760994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:06.761706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:06.807684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-891eb3e8-40f4-4eae-8e53-bf53a2a740cf None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294813 Sep 19 11:58:06.810208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 44/98] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:07.009645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:07.012331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:07.026840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:07.027771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:07.030413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:07.031429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:07.032099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:07.032695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:07.362802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:07.363453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:07.372152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:07.381558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:07.383142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-445d26d0-2121-418f-a5a6-03e334ec5321 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1339 microversion: 2.20 time: 0.379793 Sep 19 11:58:07.398863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 45/99] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1339 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:07.424558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6467bb9e-f954-428d-bc73-5bc039b7f336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.711633 Sep 19 11:58:07.428710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 55/100] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:06 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:07.536749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:07.537361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:07.549936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:07.550672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:07.551713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:07.552456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:07.552974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:07.553612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:07.586960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-2651b56b-5c43-4d78-840f-9b2d5dbe16d8 req-01c1a60a-fbfb-4cb5-bd0d-317342896ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad06da9-6475-4fc6-a5f2-a98250348a27", "tag": "4cdd9a24-9763-4015-81ba-89f136665b2a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:07.608792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2651b56b-5c43-4d78-840f-9b2d5dbe16d8 req-01c1a60a-fbfb-4cb5-bd0d-317342896ea1 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:07.609325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2651b56b-5c43-4d78-840f-9b2d5dbe16d8 req-01c1a60a-fbfb-4cb5-bd0d-317342896ea1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:07.609936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2651b56b-5c43-4d78-840f-9b2d5dbe16d8 req-01c1a60a-fbfb-4cb5-bd0d-317342896ea1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:07.640238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-2651b56b-5c43-4d78-840f-9b2d5dbe16d8 req-01c1a60a-fbfb-4cb5-bd0d-317342896ea1 service nova] Creating event network-changed:4cdd9a24-9763-4015-81ba-89f136665b2a for instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 on hv-cinder-85829 Sep 19 11:58:07.654456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-2651b56b-5c43-4d78-840f-9b2d5dbe16d8 req-01c1a60a-fbfb-4cb5-bd0d-317342896ea1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253481 Sep 19 11:58:07.658555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 46/101] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:07.668649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:07.669880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:07.681844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:07.683069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:07.684045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:07.685467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:07.686488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:07.687987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:07.924289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:07.954552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-83d65ce5-661f-439c-9e79-c5fbf8c22689 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1278 microversion: 2.1 time: 0.293070 Sep 19 11:58:07.954552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 47/102] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:07 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:08.031619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:08.039813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5809bcba-d83c-4ffd-9b66-9284f38b5443 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.506872 Sep 19 11:58:08.040742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 56/103] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:08.415014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:08.415629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:08.424962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:08.425507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:08.425934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:08.432012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:08.432012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:08.433171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:08.451151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:08.452460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:08.466545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:08.468058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:08.468461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:08.471674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:08.472170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:08.473658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:08.871165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:08.883866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:08.886033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:08.887519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:08.888769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed947f1c-5c2d-4698-b0dc-906a3840d07c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.478965 Sep 19 11:58:08.889700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 48/104] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:08.902560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b399e42e-e373-40a1-b1fa-7a3d9aa5f001 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.455935 Sep 19 11:58:08.903327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 57/105] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:08 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:08.981713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:08.982371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:08.989663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:08.990205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:08.990645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:08.991363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:08.991821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:08.992246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:09.065177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:09.065818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:09.074861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:09.075371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:09.075810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:09.076611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:09.077029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:09.077451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:09.243400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:09.251709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a26ea10d-f6d1-4857-857f-b5882c59e44a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.274232 Sep 19 11:58:09.267052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 49/106] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:08 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:09.308929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:09.322013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4450526b-2cac-47be-95a4-01e1ebadeb6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.261733 Sep 19 11:58:09.323038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 58/107] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:09.782925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-2c068fd4-c103-4855-9e6d-b253374e9871 req-523af93c-ab4e-47bd-a1f0-c96561296e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c042ae-099e-4c5c-aeb3-c6534e922e0c", "tag": "019eaaa7-c816-481f-b22e-f61de6651cef"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:09.793048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2c068fd4-c103-4855-9e6d-b253374e9871 req-523af93c-ab4e-47bd-a1f0-c96561296e06 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:09.793791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2c068fd4-c103-4855-9e6d-b253374e9871 req-523af93c-ab4e-47bd-a1f0-c96561296e06 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:09.794249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-2c068fd4-c103-4855-9e6d-b253374e9871 req-523af93c-ab4e-47bd-a1f0-c96561296e06 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:09.808715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-2c068fd4-c103-4855-9e6d-b253374e9871 req-523af93c-ab4e-47bd-a1f0-c96561296e06 service nova] Creating event network-changed:019eaaa7-c816-481f-b22e-f61de6651cef for instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c on hv-cinder-85829 Sep 19 11:58:09.815965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-2c068fd4-c103-4855-9e6d-b253374e9871 req-523af93c-ab4e-47bd-a1f0-c96561296e06 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037105 Sep 19 11:58:09.817155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 50/108] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:09.929266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:09.930270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:09.935620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:09.936584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:09.937016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:09.937273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:09.938688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:09.939590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:09.940427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:09.941011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:09.954123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:09.956195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:09.957099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:09.958587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:09.959647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:09.960480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:10.219987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:10.234940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:10.236566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:10.237718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61616c0f-cc70-48e5-8a96-51d36266da0b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.308174 Sep 19 11:58:10.238018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:10.244441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 51/109] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:10.253952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-973acd36-8cef-46b4-9a43-30109d27cc5d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.321938 Sep 19 11:58:10.253952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 59/110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:09 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:10.277069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:10.278638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:10.288419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:10.288999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:10.289436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:10.290612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:10.290612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:10.290612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:10.330435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:10.347122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:10.347765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:10.365877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:10.366289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:10.366725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:10.367970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:10.370997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:10.371451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:10.657468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:10.686069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38bdf7ac-ac52-4899-a2f2-435a8a87e2b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.339003 Sep 19 11:58:10.690003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 52/111] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:10.860110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:10.882409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcada254-72a8-4216-ae13-671d2674d974 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.610076 Sep 19 11:58:10.884994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 60/112] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:10 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:11.276198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:11.276894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:11.280372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:11.281503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:11.300345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:11.300345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:11.300345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:11.300345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:11.300862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:11.300862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:11.314042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:11.314546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:11.315286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:11.316027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:11.316487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:11.319336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:12.007961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:12.027237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47d63123-7c56-4914-9d62-0523e8e3d54e tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.756108 Sep 19 11:58:12.031283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 61/113] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:11 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:12.053990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:12.061310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:12.074822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:12.075857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:12.076518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:12.077411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:12.078978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:12.079745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:12.133123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:12.148452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:12.153467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:12.155000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eb4c9e28-8873-47a5-a225-3e3b91e2adf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.889354 Sep 19 11:58:12.158770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 53/114] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:12.168413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:12.170938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:12.192194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:12.192994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:12.193609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:12.194547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:12.195257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:12.196152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:12.693431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:12.706872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-093c1488-867a-45d6-b3e5-f22320fc7f0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.546492 Sep 19 11:58:12.717804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 54/115] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:12 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:12.727531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:12.733048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fffbc63c-8f55-4528-b493-edf98febdea0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.695826 Sep 19 11:58:12.734807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 62/116] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:13.054303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:13.054922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:13.066884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.067378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.068115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.068841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.069294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.069913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.216687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:13.218474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:13.233045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.235145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.236272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.239741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.241292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.241958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.340835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:13.351688 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a14c0165-b311-4f8b-bc71-664bcd5dde81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.302614 Sep 19 11:58:13.366889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 55/117] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:13 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:13.385203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-85eef0ea-8340-4de0-992a-4c02f7fac8fe req-fc858696-829e-4c1c-aa1c-1d3c570a7bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:13.410286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-85eef0ea-8340-4de0-992a-4c02f7fac8fe req-fc858696-829e-4c1c-aa1c-1d3c570a7bbb service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.410970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-85eef0ea-8340-4de0-992a-4c02f7fac8fe req-fc858696-829e-4c1c-aa1c-1d3c570a7bbb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.411409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-85eef0ea-8340-4de0-992a-4c02f7fac8fe req-fc858696-829e-4c1c-aa1c-1d3c570a7bbb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.440399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-85eef0ea-8340-4de0-992a-4c02f7fac8fe req-fc858696-829e-4c1c-aa1c-1d3c570a7bbb service nova] Creating event network-changed:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 11:58:13.453386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-85eef0ea-8340-4de0-992a-4c02f7fac8fe req-fc858696-829e-4c1c-aa1c-1d3c570a7bbb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084621 Sep 19 11:58:13.454044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 56/118] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:13.681742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:13.710281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:13.717737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:13.723062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1dd0f198-aa76-403b-ba32-39e831cf3941 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.516144 Sep 19 11:58:13.729682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 63/119] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:13.748491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:13.748491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:13.761872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.762689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.763294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.764475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.765517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.766221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.766457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:13.767141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:13.778812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.779311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.785052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.786306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:13.787188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:13.787993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:13.837693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:14.326632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:14.340035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-febd3563-491e-4493-be4a-09c88f156073 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.579251 Sep 19 11:58:14.340661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 64/120] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:14.349532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:14.359997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca4a5ef8-4820-4eb6-bcdb-d9e6c6baec8b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.626703 Sep 19 11:58:14.375904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 57/121] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:13 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:14.389108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:14.392394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:14.402090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:14.403473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:14.404103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:14.405013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:14.405671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:14.406816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:14.756487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:14.757010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:14.768751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:14.769613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:14.770261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:14.771266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:14.772007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:14.772739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:15.348709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:15.375793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb4b1d76-172a-46c8-b08c-597c1da0e184 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.990455 Sep 19 11:58:15.385437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 65/122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:14 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:15.398314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:15.399661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:15.409017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:15.410566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:15.411262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:15.412494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:15.413170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:15.415961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:15.420109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:15.453458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:15.459218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:15.466024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1de0fe4d-7354-4db2-93cb-e70d03342e11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.709357 Sep 19 11:58:15.469904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 58/123] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:58:15.493908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:15.496952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:15.524125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:15.524982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:15.525996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:15.532654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:15.533146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:15.533587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:15.967067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:15.992347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9513a6cd-bcaa-4adb-85d9-3b3693634f67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.604312 Sep 19 11:58:15.995870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 66/124] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:16.014570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-fcb72919-558c-46d7-ae68-a00cb6157f8c req-7081179c-d5d3-4345-a68d-bcb781683f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8301e0d-d1bf-432a-b68f-1692e5621b8f", "tag": "014d07ed-89c0-4c1c-ad81-4220f7049349"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:16.044432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fcb72919-558c-46d7-ae68-a00cb6157f8c req-7081179c-d5d3-4345-a68d-bcb781683f07 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:16.045164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fcb72919-558c-46d7-ae68-a00cb6157f8c req-7081179c-d5d3-4345-a68d-bcb781683f07 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:16.045780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fcb72919-558c-46d7-ae68-a00cb6157f8c req-7081179c-d5d3-4345-a68d-bcb781683f07 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:16.070817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-fcb72919-558c-46d7-ae68-a00cb6157f8c req-7081179c-d5d3-4345-a68d-bcb781683f07 service nova] Creating event network-changed:014d07ed-89c0-4c1c-ad81-4220f7049349 for instance c8301e0d-d1bf-432a-b68f-1692e5621b8f on hv-cinder-85829 Sep 19 11:58:16.072372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fcb72919-558c-46d7-ae68-a00cb6157f8c req-7081179c-d5d3-4345-a68d-bcb781683f07 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 11:58:16.073398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fcb72919-558c-46d7-ae68-a00cb6157f8c req-7081179c-d5d3-4345-a68d-bcb781683f07 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 11:58:16.075822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:16.076797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:16.077789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:16.079466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:16.080242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:16.080967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:16.095239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.compute.rpcapi [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 11:58:16.096640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] Releasing lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 11:58:16.119977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bdd88c0-8ed9-4945-b20e-584a3578cc37 None None] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119277 Sep 19 11:58:16.121471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 67/125] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:16.122948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:16.138028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f8c393f-36ae-4171-bc9d-9812eff5c95a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.666729 Sep 19 11:58:16.142284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 59/126] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:15 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:16.413743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:16.414681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:16.427087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:16.427970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:16.428623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:16.429704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:16.430562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:16.431345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:16.497077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:16.497811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:16.506191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:16.506704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:16.510481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:16.514968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:16.516301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:16.516950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:16.746077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:16.919119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:16.946809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4da1da3f-09aa-4227-8856-5278b3b3f714 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.537619 Sep 19 11:58:16.948488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 68/127] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:16 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:16.956889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:16.974709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:16.979595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:16.981415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dc71ff5c-fe46-4871-b43a-d8e2c1e9ef64 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.488382 Sep 19 11:58:16.997869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 60/128] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:17.027100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:17.029099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:17.043456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:17.044507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:17.045467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:17.046690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:17.047383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:17.048635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:17.171883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:17.172661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:17.181215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:17.181954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:17.182554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:17.183333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:17.189537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:17.190114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:17.648320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:17.653109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:17.677196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e3a73e9-81e0-4797-b253-1a5e631725d3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.511270 Sep 19 11:58:17.678576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 61/129] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:17 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:17.681701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a5dd0c0-f75e-4ad3-8ab0-3f1d05213d07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.662050 Sep 19 11:58:17.697722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 69/130] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:17.974190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:17.976875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:18.000471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.000963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.001392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.002131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.002579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.009021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.090943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-578f3215-d134-42ac-a1ef-5e484c0647b2 req-f65f0a7d-3972-4669-b1e5-99206e94a935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88", "name": "network-vif-plugged", "status": "completed", "tag": "60e4df69-30ab-4bd6-8f47-3dc96227847c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:18.109723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-578f3215-d134-42ac-a1ef-5e484c0647b2 req-f65f0a7d-3972-4669-b1e5-99206e94a935 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.111500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-578f3215-d134-42ac-a1ef-5e484c0647b2 req-f65f0a7d-3972-4669-b1e5-99206e94a935 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.113159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-578f3215-d134-42ac-a1ef-5e484c0647b2 req-f65f0a7d-3972-4669-b1e5-99206e94a935 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.171970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-578f3215-d134-42ac-a1ef-5e484c0647b2 req-f65f0a7d-3972-4669-b1e5-99206e94a935 service nova] Creating event network-vif-plugged:60e4df69-30ab-4bd6-8f47-3dc96227847c for instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 on hv-cinder-85829 Sep 19 11:58:18.190548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-578f3215-d134-42ac-a1ef-5e484c0647b2 req-f65f0a7d-3972-4669-b1e5-99206e94a935 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.508519 Sep 19 11:58:18.194383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 62/131] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:18.205200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:18.209384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:18.230077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.232262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.233349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.236386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.239574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.240267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.385624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:18.398638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-681f1c5e-967b-4a35-a9b0-4fd494dbe70b tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.428351 Sep 19 11:58:18.400069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 70/132] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:17 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:18.504251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:18.522706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:18.525285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:18.528748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae4460c4-da4d-4a43-bb1d-86050b442f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.332666 Sep 19 11:58:18.529700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 63/133] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:18.707830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:18.717423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:18.719022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:18.719492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:18.741257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.743257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.745519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.746267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.746977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.748062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.749448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.753190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.753359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:18.754287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:18.754884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:18.755820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:19.155094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:19.163207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c5cbf38-9c09-4e23-803a-b424d8355b50 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.462496 Sep 19 11:58:19.181810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 71/134] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:18 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:19.219131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:19.227959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8f26145-bafe-4733-8ff2-cd88fbc74584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.516979 Sep 19 11:58:19.243898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 64/135] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:19.425159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:19.426568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:19.434940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:19.435825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:19.436636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:19.437840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:19.439595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:19.440327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:19.555563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:19.557209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:19.566894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:19.567604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:19.568266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:19.569194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:19.569862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:19.570591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:19.740053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:19.750739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f18a21d-d574-4d5b-a7a0-97d70aa62e24 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.328905 Sep 19 11:58:19.753660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 72/136] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:19 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:19.826478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:19.835816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:19.837444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:19.840047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-886e6f8b-a447-4b5d-bb30-3c7625af118a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.288542 Sep 19 11:58:19.841299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 65/137] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:20.200720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:20.216764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:20.221538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-6a3a96a6-279b-43c5-9353-7342ccc4f4ad req-bc599ea4-a9a1-4114-8983-573221afeea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c042ae-099e-4c5c-aeb3-c6534e922e0c", "name": "network-vif-plugged", "status": "completed", "tag": "019eaaa7-c816-481f-b22e-f61de6651cef"}, {"server_uuid": "9ad06da9-6475-4fc6-a5f2-a98250348a27", "name": "network-vif-plugged", "status": "completed", "tag": "4cdd9a24-9763-4015-81ba-89f136665b2a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:20.234915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.236096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.237115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.239119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.240363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.241605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.244514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6a3a96a6-279b-43c5-9353-7342ccc4f4ad req-bc599ea4-a9a1-4114-8983-573221afeea5 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.246928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6a3a96a6-279b-43c5-9353-7342ccc4f4ad req-bc599ea4-a9a1-4114-8983-573221afeea5 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.248813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6a3a96a6-279b-43c5-9353-7342ccc4f4ad req-bc599ea4-a9a1-4114-8983-573221afeea5 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.273307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-6a3a96a6-279b-43c5-9353-7342ccc4f4ad req-bc599ea4-a9a1-4114-8983-573221afeea5 service nova] Creating event network-vif-plugged:019eaaa7-c816-481f-b22e-f61de6651cef for instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c on hv-cinder-85829 Sep 19 11:58:20.274153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-6a3a96a6-279b-43c5-9353-7342ccc4f4ad req-bc599ea4-a9a1-4114-8983-573221afeea5 service nova] Creating event network-vif-plugged:4cdd9a24-9763-4015-81ba-89f136665b2a for instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 on hv-cinder-85829 Sep 19 11:58:20.285468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-6a3a96a6-279b-43c5-9353-7342ccc4f4ad req-bc599ea4-a9a1-4114-8983-573221afeea5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068750 Sep 19 11:58:20.286112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 66/138] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:20.293044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:20.293745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:20.314214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.314699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.315130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.315835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.316283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.316702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.507488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:20.519673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-405fc322-9e35-4ef5-a42c-3693e850939f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.330037 Sep 19 11:58:20.520811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 73/139] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:20 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:20.584141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:20.593267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6720925c-6af6-4dd9-af14-e1da3734dd60 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.304460 Sep 19 11:58:20.594382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 67/140] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:20.779528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:20.780518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:20.787718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.788202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.788636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.789341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.789799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.790593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.866649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:20.867669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:20.880145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.880948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.881536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:20.882601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:20.883217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:20.884061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:21.072458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:21.083283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90747f3f-de63-40b1-9b1b-95df9cd670a6 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.308186 Sep 19 11:58:21.083868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 74/141] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:20 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:21.098550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:21.112193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:21.113691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:21.114905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb06f631-d2a3-4324-9bf9-8c3e68beb2a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.252567 Sep 19 11:58:21.115430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 68/142] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:58:21.544944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:21.545628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:21.552664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:21.553594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:21.554286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:21.555289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:21.556014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:21.556676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:21.619987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:21.621071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:21.662781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:21.665449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:21.666130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:21.667023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:21.668130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:21.670228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:22.383519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:22.393197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5d8b1eb-5973-4ad9-9c74-12e0582e0dbc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.852957 Sep 19 11:58:22.406342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 75/143] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:21 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:22.416359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:22.423894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:22.440766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:22.441477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:22.441991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:22.444715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:22.445488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:22.447447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:22.593309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:22.625015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f85e77de-3a3e-41b0-b1cc-50057be3190a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 1.003193 Sep 19 11:58:22.628391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 69/144] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:22.635847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:22.636808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:22.646941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:22.647852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:22.648606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:22.649573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:22.650734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:22.652405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:22.919423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:22.939084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:22.943303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:22.945380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf753a18-6b5d-458a-a811-f72b1507f7f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.315604 Sep 19 11:58:22.946330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:22.947005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 70/145] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:22.984564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a844d035-2100-449f-be10-ec6e6cbadc34 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.564891 Sep 19 11:58:22.993944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 76/146] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:22 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:23.428685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:23.429488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:23.438063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:23.441497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:23.442530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:23.445727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:23.446328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:23.446842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:23.655712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:23.658639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:23.666250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:23.666744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:23.672448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:23.673389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:23.674391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:23.678685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:23.758768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:23.770849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:23.786072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3041858d-c504-4a26-adf0-3f5f8dce8364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.360887 Sep 19 11:58:23.788126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 71/147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:23 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:23.972420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:23.973341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:23.983055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:23.989921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:23.990444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:23.990815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:23.991903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:23.992019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:23.992378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:23.995153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b27163a-3cb1-4012-9211-a0c8852caef8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1362 microversion: 2.1 time: 0.343351 Sep 19 11:58:24.010001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 77/148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:24.037719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:24.038400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:24.045725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:24.047539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:24.047991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:24.048717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:24.049383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:24.049878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:24.476437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:24.487917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:24.489195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:24.491179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:24.494265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-258d318b-c04f-4f28-86d0-0b548536a045 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.526019 Sep 19 11:58:24.496413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 72/149] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:58:24.506194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad0b3589-459f-4783-b0de-afb8f772380d tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1314 microversion: 2.1 time: 0.473854 Sep 19 11:58:24.522113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 78/150] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:24 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:24.815394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:24.816538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:24.822810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:24.824067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:24.824773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:24.826254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:24.826895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:24.827325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:25.050862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:25.059857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:25.068822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:25.078922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-33823c17-7542-4294-8a08-e35b41d285bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.268919 Sep 19 11:58:25.079522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 73/151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:24 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:25.095309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:25.096994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:25.099454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:25.101027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:25.102070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:25.103229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:25.457100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-8b4c5c61-0a13-456a-b67c-975ccef60652 req-09f1c33b-b42e-4c9d-90d7-3b0ab688cdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8301e0d-d1bf-432a-b68f-1692e5621b8f", "name": "network-vif-plugged", "status": "completed", "tag": "014d07ed-89c0-4c1c-ad81-4220f7049349"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:25.472835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8b4c5c61-0a13-456a-b67c-975ccef60652 req-09f1c33b-b42e-4c9d-90d7-3b0ab688cdf2 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:25.473756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8b4c5c61-0a13-456a-b67c-975ccef60652 req-09f1c33b-b42e-4c9d-90d7-3b0ab688cdf2 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:25.474396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8b4c5c61-0a13-456a-b67c-975ccef60652 req-09f1c33b-b42e-4c9d-90d7-3b0ab688cdf2 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:25.491882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-8b4c5c61-0a13-456a-b67c-975ccef60652 req-09f1c33b-b42e-4c9d-90d7-3b0ab688cdf2 service nova] Creating event network-vif-plugged:014d07ed-89c0-4c1c-ad81-4220f7049349 for instance c8301e0d-d1bf-432a-b68f-1692e5621b8f on hv-cinder-85829 Sep 19 11:58:25.501663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-8b4c5c61-0a13-456a-b67c-975ccef60652 req-09f1c33b-b42e-4c9d-90d7-3b0ab688cdf2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049995 Sep 19 11:58:25.503866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 74/152] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:25.528040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:25.528444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:25.529564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:25.555661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad7605ab-f930-48d5-8cdc-4eb7b63b05c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1549 microversion: 2.1 time: 0.529451 Sep 19 11:58:25.558735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:25.559863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:25.560703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:25.560855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 79/153] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1549 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:25.563215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:25.563928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:25.564640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:25.600459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:25.608278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:25.646544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:25.647396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:25.647940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:25.648787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:25.651255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:25.651866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:26.032970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:26.040840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:26.050582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:26.051519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7289538c-941d-42eb-835d-ecff6f4b8336 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1501 microversion: 2.1 time: 0.470086 Sep 19 11:58:26.052872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 80/154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:25 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1501 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:26.054529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:26.056628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-636ed6f1-8898-4648-9a54-4cb002dda5fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.537579 Sep 19 11:58:26.057557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 75/155] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:26.059011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:26.059617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:26.066159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:26.066953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:26.067755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:26.068724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:26.069354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:26.069970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:26.107060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.107870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:26.109732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:26.120609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:26.121657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:26.122755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:26.124098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:26.125288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:26.126678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:26.133976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:26.474153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-81b73bef-fa9b-4d21-9d52-39e93a804c4e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.418817 Sep 19 11:58:26.475019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 81/156] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Sep 19 11:58:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-interface => generated 285 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:26.542620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:26.556632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-be814604-ebe5-49d6-ae42-478cdf9720bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.453878 Sep 19 11:58:26.558945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 76/157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:26 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:27.087143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:27.087923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:27.096907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:27.097751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:27.098574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:27.099612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:27.100488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:27.101158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:27.445091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:27.462671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:27.467168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:27.469117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7937d2f1-4528-4979-96e7-f8b831d6509f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.388232 Sep 19 11:58:27.470396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 82/158] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:58:27.527856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-686e89cf-0c2d-479f-bfbd-a4a90839cd1c req-1f94e2ee-3eba-4157-b284-bb11ca6cbbbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "name": "network-vif-plugged", "status": "completed", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:27.550762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-686e89cf-0c2d-479f-bfbd-a4a90839cd1c req-1f94e2ee-3eba-4157-b284-bb11ca6cbbbd service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:27.551248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-686e89cf-0c2d-479f-bfbd-a4a90839cd1c req-1f94e2ee-3eba-4157-b284-bb11ca6cbbbd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:27.551679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-686e89cf-0c2d-479f-bfbd-a4a90839cd1c req-1f94e2ee-3eba-4157-b284-bb11ca6cbbbd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:27.578617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-686e89cf-0c2d-479f-bfbd-a4a90839cd1c req-1f94e2ee-3eba-4157-b284-bb11ca6cbbbd service nova] Creating event network-vif-plugged:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 11:58:27.583804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-686e89cf-0c2d-479f-bfbd-a4a90839cd1c req-1f94e2ee-3eba-4157-b284-bb11ca6cbbbd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060915 Sep 19 11:58:27.584736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 77/159] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:27.597799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:27.599650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:27.609605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:27.610170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:27.616347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:27.617521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:27.618385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:27.618989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:27.801573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0fbaeca-35f4-4f52-8c66-0a56b15aedb3"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:27.805178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:27.820347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:27.821524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:27.824282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:27.826719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:27.827197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:27.828187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:27.895869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:27.905190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d170243d-5d71-4ff5-b61f-3da43b535764 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1320 microversion: 2.1 time: 0.313777 Sep 19 11:58:27.906583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 83/160] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:27 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:28.500742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:28.502178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:28.510126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:28.511073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:28.511752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:28.513390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:28.514421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:28.515967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:28.755514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:28.767554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:28.769515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:28.771497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17fe001d-a9ae-4049-886a-812239e43a46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.274826 Sep 19 11:58:28.773073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 84/161] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:58:28.780277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-9dd98e78-0171-42c3-996d-72e5801a3dee req-af854b3b-2d57-4e91-9402-ac5bcaff1fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad06da9-6475-4fc6-a5f2-a98250348a27", "tag": "4cdd9a24-9763-4015-81ba-89f136665b2a"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:28.793195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9dd98e78-0171-42c3-996d-72e5801a3dee req-af854b3b-2d57-4e91-9402-ac5bcaff1fa3 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:28.794053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9dd98e78-0171-42c3-996d-72e5801a3dee req-af854b3b-2d57-4e91-9402-ac5bcaff1fa3 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:28.794808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-9dd98e78-0171-42c3-996d-72e5801a3dee req-af854b3b-2d57-4e91-9402-ac5bcaff1fa3 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:28.809472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-9dd98e78-0171-42c3-996d-72e5801a3dee req-af854b3b-2d57-4e91-9402-ac5bcaff1fa3 service nova] Creating event network-changed:4cdd9a24-9763-4015-81ba-89f136665b2a for instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 on hv-cinder-85829 Sep 19 11:58:28.817899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-9dd98e78-0171-42c3-996d-72e5801a3dee req-af854b3b-2d57-4e91-9402-ac5bcaff1fa3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041363 Sep 19 11:58:28.818690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 85/162] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:28.936264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:28.937014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:28.951242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:28.954165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:28.954889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:28.955788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:28.956404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:28.956999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:29.001032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46b25285-16d3-4600-8330-f87941386ccd tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "POST /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.203941 Sep 19 11:58:29.002130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 78/163] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 11:58:27 2022] POST /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:29.243358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:29.265819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f989904c-d67a-4e39-86d3-8d266c90ef27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1514 microversion: 2.1 time: 0.340968 Sep 19 11:58:29.271314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 86/164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:28 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:29.298420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:29.300901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:29.324119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:29.324621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:29.325062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:29.325801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:29.326323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:29.326695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:29.410428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lazy-loading 'flavor' on Instance uuid c8301e0d-d1bf-432a-b68f-1692e5621b8f {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:58:29.572356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c134b1e2-8a66-462e-9cf2-8d1d4a6f7540 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f/action" status: 200 len: 32 microversion: 2.1 time: 0.278293 Sep 19 11:58:29.574659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 79/165] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 11:58:29 2022] POST /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:58:29.586816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:29.587754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:29.601362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:29.601927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:29.604697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:29.605649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:29.607678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:29.609734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:29.808290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:29.809466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:29.836063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:29.837492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:29.840739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:29.841644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:29.842229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:29.842893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:29.845429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:29.855466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd5a5bd4-ed0b-46c7-9530-4f4931c0afd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.274471 Sep 19 11:58:29.856613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 87/166] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:29 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:30.045287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:30.058925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:30.062405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:30.065615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0616b0ee-c7a1-447d-8e98-5e8aeae8a9d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1406 microversion: 2.20 time: 0.263251 Sep 19 11:58:30.066990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 80/167] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:58:30.880809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:30.881419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:30.888571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:30.888571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:30.888833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:30.889526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:30.890666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:30.891103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:31.067179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:31.089568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-995f8bec-9295-4c5d-9c5b-81f4d9f6dec9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.212279 Sep 19 11:58:31.102405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 88/168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:30 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:31.107061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:31.107671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:31.111304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=89 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:31.114929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:31.115433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:31.116277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:31.116951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:31.117364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:31.117824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:31.450163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:31.469940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:31.477784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:31.481246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef99c28b-0cae-4a53-a630-3582c0bd78c8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1598 microversion: 2.20 time: 0.376214 Sep 19 11:58:31.482518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 81/169] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:58:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1598 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:58:31.515410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:31.515909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:31.560348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:31.561052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:31.568987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:31.570010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:31.570718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:31.571304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:31.706300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1b1be45-44e4-4f44-9aae-1b6e7d63914a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.195666 Sep 19 11:58:31.706887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 89/170] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Sep 19 11:58:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:58:32.117534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:32.119234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:32.132838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:32.133909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:32.134616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:32.135845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:32.136630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:32.137920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:32.758047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:32.767936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-958b19d4-1363-4c3b-a73e-7ca97f91e3ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.656838 Sep 19 11:58:32.768617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 82/171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:32 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:33.407383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-b740cfb3-a140-4a98-b72e-42df1193a895 req-619f0535-1fde-4dc2-a591-9a2b2e11d9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:33.426026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b740cfb3-a140-4a98-b72e-42df1193a895 req-619f0535-1fde-4dc2-a591-9a2b2e11d9b4 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:33.426602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b740cfb3-a140-4a98-b72e-42df1193a895 req-619f0535-1fde-4dc2-a591-9a2b2e11d9b4 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:33.427098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b740cfb3-a140-4a98-b72e-42df1193a895 req-619f0535-1fde-4dc2-a591-9a2b2e11d9b4 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:33.440871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b740cfb3-a140-4a98-b72e-42df1193a895 req-619f0535-1fde-4dc2-a591-9a2b2e11d9b4 service nova] Creating event network-changed:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 11:58:33.447753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-b740cfb3-a140-4a98-b72e-42df1193a895 req-619f0535-1fde-4dc2-a591-9a2b2e11d9b4 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045784 Sep 19 11:58:33.449318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 90/172] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:33.793412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:33.794915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:33.803246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:33.803752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:33.804265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:33.804975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:33.805434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:33.805894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:33.962273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:33.971748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6e01140d-c56a-43f3-bd04-ae165dd5ffe6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.183479 Sep 19 11:58:33.987473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 83/173] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:33 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:34.998384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:34.999084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:35.001971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=79 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:35.007733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:35.008423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:35.008953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:35.009555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:35.010038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:35.010586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:35.169651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:35.179401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ceb07e4-7bff-49c0-a4a7-004a9c043d48 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.185289 Sep 19 11:58:35.179982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 91/174] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:34 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:36.203235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:36.203965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:36.210606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:36.211189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:36.211709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:36.212456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:36.212916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:36.213340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:36.348896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:36.357732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c45464af-18b2-40d0-9d8e-1ca2b200795a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.158379 Sep 19 11:58:36.358331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 84/175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:36 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:37.380520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:37.381129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:37.387208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:37.387695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:37.388222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:37.389034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:37.389489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:37.390441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:37.521648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:37.531413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebd89d2e-be74-477f-af77-15d2b5176611 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.154070 Sep 19 11:58:37.532271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 92/176] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:37 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:38.558789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:38.559440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:38.567945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:38.568529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:38.569073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:38.569914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:38.570420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:38.570914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:38.711804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:38.720430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39d54892-0fa4-457e-bb8b-82d822d1246d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.165823 Sep 19 11:58:38.721061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 85/177] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:38 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:39.743321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:39.743937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:39.750924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:39.751414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:39.751851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:39.752543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:39.752998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:39.753423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:39.893325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:39.901126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a181ca4-8a97-4b6f-946f-5f3f1d338209 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.161646 Sep 19 11:58:39.901700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 93/178] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:39 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:40.924350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:40.924966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:40.931399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:40.931897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:40.932337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:40.933039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:40.933526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:40.933986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:41.076247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:41.084862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da0de95e-fee5-49e1-8bcd-9fedcc7d6fef tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.165065 Sep 19 11:58:41.085430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 86/179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:40 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:42.108210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:42.108852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:42.115096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:42.115918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:42.116679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:42.117978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:42.118764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:42.119549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:42.262359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:42.270148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-417aefc2-00aa-4c7a-bcf4-201fa004e708 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.165750 Sep 19 11:58:42.270720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 94/180] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:42 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:58:43.293079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:43.294132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:43.301356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:43.301881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:43.302319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:43.303028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:43.303484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:43.303914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:43.440745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:43.449099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49cc3d24-1d87-4354-a939-515ad534f0b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.160096 Sep 19 11:58:43.449702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 87/181] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:43 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:44.474099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:44.474785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:44.482009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:44.483161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:44.483569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:44.484510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:44.485065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:44.485533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:44.634019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:44.643430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5dc92c1-89dc-4c00-9018-39c3f2bba0e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.173887 Sep 19 11:58:44.643969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 95/182] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:44 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:45.667139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:45.667740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:45.674421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:45.674912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:45.675382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:45.676116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:45.676589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:45.677053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:45.817799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:45.825592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c09b77a-a4f1-41e3-81d1-a14a6e5767b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.162775 Sep 19 11:58:45.826193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 88/183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:45 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:46.848599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:46.849207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:46.855183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:46.855672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:46.856135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:46.856809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:46.857264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:46.857690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:46.862646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:46.997333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:47.005746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f00201b-d641-4da7-9ff6-eb1515c7f8bb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.161022 Sep 19 11:58:47.006331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 96/184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:46 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:47.400192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:47.400716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:47.407818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:47.408312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:47.408746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:47.409707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:47.410204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:47.410628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:47.438259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:58:47.454436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:47.541191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af34ab0f-035c-4258-afb8-3de47e04575a tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 204 len: 0 microversion: 2.1 time: 0.142511 Sep 19 11:58:47.542083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 89/185] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 11:58:47 2022] DELETE /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:58:47.551995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:47.552612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:47.558569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:47.559118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:47.559733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:47.560449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:47.560965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:47.562083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:47.704462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:47.712671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3116e148-bcea-4123-bb48-6c30a0cb8878 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1553 microversion: 2.1 time: 0.164953 Sep 19 11:58:47.713241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 97/186] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:47 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:48.029294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:48.030824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:48.037556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:48.038260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:48.038769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:48.039663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:48.040128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:48.040629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:48.178678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:48.187903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9b2e629-0d16-4a5a-b92c-1ede7cba1e36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.162750 Sep 19 11:58:48.188477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 90/187] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:48 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:48.737428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:48.738349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:48.744968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:48.745655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:48.746123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:48.746828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:48.747288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:48.747711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:48.891949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:48.900525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb66ae77-9159-4c0d-9798-92c1a0ceb5d0 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1553 microversion: 2.1 time: 0.168096 Sep 19 11:58:48.901085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 98/188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:48 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:49.211260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:49.211870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:49.218729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:49.219217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:49.219653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:49.220348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:49.220804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:49.221227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:49.351109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:49.359241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4c800810-17e6-445d-b5cb-881749fb5080 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.151957 Sep 19 11:58:49.359844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 91/189] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:49 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:49.924963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:49.925569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:49.931502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:49.931979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:49.932414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:49.933098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:49.933544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:49.933996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:50.067455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:50.075918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f635fa5d-360c-4ba5-92c4-a57056323d18 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1553 microversion: 2.1 time: 0.155441 Sep 19 11:58:50.076594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 99/190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:49 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:50.383140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:50.383687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:50.391379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:50.391857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:50.392282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:50.392967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:50.393419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:50.393865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:50.523542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:50.531647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5cf67d28-e197-4806-853a-f824378e7d46 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.152431 Sep 19 11:58:50.532212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 92/191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:50 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:51.099872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:51.100387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:51.106441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:51.106933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:51.107369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:51.108064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:51.108520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:51.108943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:51.249062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:51.257305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d73d70c-d334-45f0-ab23-5f68e8a93c65 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1553 microversion: 2.1 time: 0.161417 Sep 19 11:58:51.258265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 100/192] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:51 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:51.555443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:51.556116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:51.562873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:51.563375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:51.563836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:51.564539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:51.564984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:51.565398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:51.702721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:51.710751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a080e3ba-19d4-4642-a5fc-7f9f8cfba46f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.159154 Sep 19 11:58:51.712210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 93/193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:51 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:52.290551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:52.292662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:52.315090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:52.317312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:52.317970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:52.320059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:52.322703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:52.325001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:52.422241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-533e22f4-4f03-4972-967d-21779e991ec3 req-201fab9b-0250-4f15-848d-94c0bbf62ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c042ae-099e-4c5c-aeb3-c6534e922e0c", "name": "network-vif-deleted", "tag": "019eaaa7-c816-481f-b22e-f61de6651cef"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:58:52.444389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-533e22f4-4f03-4972-967d-21779e991ec3 req-201fab9b-0250-4f15-848d-94c0bbf62ed3 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:52.444898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-533e22f4-4f03-4972-967d-21779e991ec3 req-201fab9b-0250-4f15-848d-94c0bbf62ed3 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:52.445331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-533e22f4-4f03-4972-967d-21779e991ec3 req-201fab9b-0250-4f15-848d-94c0bbf62ed3 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:52.478120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:52.481219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-533e22f4-4f03-4972-967d-21779e991ec3 req-201fab9b-0250-4f15-848d-94c0bbf62ed3 service nova] Creating event network-vif-deleted:019eaaa7-c816-481f-b22e-f61de6651cef for instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c on hv-cinder-85829 Sep 19 11:58:52.487332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-533e22f4-4f03-4972-967d-21779e991ec3 req-201fab9b-0250-4f15-848d-94c0bbf62ed3 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073114 Sep 19 11:58:52.487475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6c8c651-051e-411c-b59f-a95c3bf130bf tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1511 microversion: 2.1 time: 0.203090 Sep 19 11:58:52.488162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 94/194] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:52.492046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 101/195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:52 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1511 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:52.735813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:52.736587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:52.746404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:52.750614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:52.751325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:52.752262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:52.754095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:52.756286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:52.995154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:53.005213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-53c3ae22-5ad3-4b35-adf4-31f75430a44c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.274334 Sep 19 11:58:53.005823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 95/196] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:52 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:53.520976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:53.521630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:53.529851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:53.530355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:53.530931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:53.531628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:53.532084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:53.532516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:53.571262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:53.571262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:53.571262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:53.571262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lazy-loading 'fault' on Instance uuid e1c042ae-099e-4c5c-aeb3-c6534e922e0c {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:58:53.633510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1015b24d41f446069b0e0884b92a1772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced3cefcaf434541a38dd01270076279', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:53.644273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1db5d1d-cb02-4ef3-bc87-750aa4bf158c tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 200 len: 1350 microversion: 2.1 time: 0.129464 Sep 19 11:58:53.646129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 102/197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:53 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:54.030878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:54.032076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:54.039911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:54.040783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:54.041404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:54.042287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:54.042749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:54.043181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:54.214996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:54.224366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8d33b79-2a60-4da9-b163-b73200e57fd6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.198135 Sep 19 11:58:54.224956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 96/198] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:54 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:54.670723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:54.672850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:54.679821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:54.680314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:54.681467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:54.682283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:54.682741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:54.683161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:54.698103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] HTTP exception thrown: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Request method failure captured: Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c HTTP/1.1 Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk3ZgixVA_d-YATuGqA8usn5WPgF3zA4dqubgQLXeobv23bM7v_SOCVUcODQqtg7MzE5XMMgY_E2r6Vo5dsOcTrU5T0hHHlQjbhpJFnoYBhj2Y8SOTjGIsK0mf348iBknhwYBSYWfS14J0a0RPHY2QWPPrA_3sCaKtCkgtgzaoYg4o Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:58:54.703497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced3cefcaf434541a38dd01270076279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced3cefcaf434541a38dd01270076279", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 1015b24d41f446069b0e0884b92a1772 Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.706135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'e1c042ae-099e-4c5c-aeb3-c6534e922e0c'} Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:58:54.707354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.709073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.710242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Returning 404 to user: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:58:54.710242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-419936ea-9e15-44c8-a2c7-715c294c5a81 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 404 len: 111 microversion: 2.1 time: 0.038296 Sep 19 11:58:54.710242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 103/199] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:54 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:58:54.834059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:54.837045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:54.843741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:54.844240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:54.844683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:54.845879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:54.846454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:54.846889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:54.862423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] HTTP exception thrown: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Request method failure captured: Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c/os-volume_attachments HTTP/1.1 Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFk3ZgixVA_d-YATuGqA8usn5WPgF3zA4dqubgQLXeobv23bM7v_SOCVUcODQqtg7MzE5XMMgY_E2r6Vo5dsOcTrU5T0hHHlQjbhpJFnoYBhj2Y8SOTjGIsK0mf348iBknhwYBSYWfS14J0a0RPHY2QWPPrA_3sCaKtCkgtgzaoYg4o Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 11:58:54.867852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced3cefcaf434541a38dd01270076279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced3cefcaf434541a38dd01270076279", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 1015b24d41f446069b0e0884b92a1772 Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.869225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': 'e1c042ae-099e-4c5c-aeb3-c6534e922e0c'} Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:58:54.870296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:58:54.871697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:58:54.873238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Returning 404 to user: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:58:54.873238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1e97e56c-3646-4c9d-92cd-f39028bf8582 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041058 Sep 19 11:58:54.873238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 97/200] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 11:58:54 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 11:58:55.251759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:55.252367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:55.258318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:55.258804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:55.259238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:55.259935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:55.260389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:55.260815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:55.417485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:55.427189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78ddd0a3-6b8d-4174-8ef4-5862105e2922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.179713 Sep 19 11:58:55.427750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 104/201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:55 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:56.450152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:56.450762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:56.458236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:56.458770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:56.459205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:56.459901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:56.460352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:56.460771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:56.607899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:56.616767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-096aba9b-7540-4fba-ac44-9e7c8cd91cad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.170351 Sep 19 11:58:56.617402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 98/202] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:56 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:57.640497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:57.641103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:57.647120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:57.647594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:57.648046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:57.648705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:57.649160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:57.649569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:57.793516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:57.803442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3aae1d02-dff2-4f1f-803a-1e3cc7fdfd6a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.166871 Sep 19 11:58:57.804019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 105/203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:57 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:58:58.827836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:58.828439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:58.834528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:58.835008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:58.835438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:58.836126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:58.836575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:58.836991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:58.968986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:58:58.976694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a37acc6-e33a-4360-982f-ed67927d24be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.153506 Sep 19 11:58:58.977256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 99/204] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:58 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:00.000498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:00.001160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:00.008122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:00.008867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:00.009123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:00.009857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:00.010376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:00.010856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:00.148948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:00.157052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db58d202-f00d-49c0-b5e2-4f47aa8a87d2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.160515 Sep 19 11:59:00.157636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 106/205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:58:59 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:00.326097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:00.327281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:00.333611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:00.334139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:00.334570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:00.335259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:00.335708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:00.336297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:00.350394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] HTTP exception thrown: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Request method failure captured: Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c HTTP/1.1 Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFk3ZgixVA_d-YATuGqA8usn5WPgF3zA4dqubgQLXeobv23bM7v_SOCVUcODQqtg7MzE5XMMgY_E2r6Vo5dsOcTrU5T0hHHlQjbhpJFnoYBhj2Y8SOTjGIsK0mf348iBknhwYBSYWfS14J0a0RPHY2QWPPrA_3sCaKtCkgtgzaoYg4o Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 11:59:00.352506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced3cefcaf434541a38dd01270076279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced3cefcaf434541a38dd01270076279", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 1015b24d41f446069b0e0884b92a1772 Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'e1c042ae-099e-4c5c-aeb3-c6534e922e0c'} Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:59:00.357730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.359119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.360525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Returning 404 to user: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:59:00.360525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3810e108-dd54-4699-8e3a-9ffd63b305e8 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "DELETE /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 404 len: 111 microversion: 2.1 time: 0.031757 Sep 19 11:59:00.360525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 100/206] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 11:59:00 2022] DELETE /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:59:00.366058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:00.366934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] [instance: e1c042ae-099e-4c5c-aeb3-c6534e922e0c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:00.372864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:00.373933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:00.374354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:00.375062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:00.375517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:00.375957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:00.389928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] HTTP exception thrown: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Request method failure captured: Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c HTTP/1.1 Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk3ZgixVA_d-YATuGqA8usn5WPgF3zA4dqubgQLXeobv23bM7v_SOCVUcODQqtg7MzE5XMMgY_E2r6Vo5dsOcTrU5T0hHHlQjbhpJFnoYBhj2Y8SOTjGIsK0mf348iBknhwYBSYWfS14J0a0RPHY2QWPPrA_3sCaKtCkgtgzaoYg4o Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:59:00.391479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ced3cefcaf434541a38dd01270076279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ced3cefcaf434541a38dd01270076279"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ced3cefcaf434541a38dd01270076279", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ced3cefcaf434541a38dd01270076279 Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1188411825 Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 1015b24d41f446069b0e0884b92a1772 Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1188411825-project Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.392925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'e1c042ae-099e-4c5c-aeb3-c6534e922e0c'} Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:59:00.393606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. Sep 19 11:59:00.394986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:00.396260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] Returning 404 to user: Instance e1c042ae-099e-4c5c-aeb3-c6534e922e0c could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:59:00.396260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-471fea3b-7aca-4816-b83f-4baf32c10024 tempest-DeleteServersTestJSON-1188411825 tempest-DeleteServersTestJSON-1188411825-project] 10.222.0.88 "GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c" status: 404 len: 111 microversion: 2.1 time: 0.030953 Sep 19 11:59:00.396260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 107/207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:00 2022] GET /compute/v2.1/servers/e1c042ae-099e-4c5c-aeb3-c6534e922e0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:59:00.725309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1447445232", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "networks": [{"uuid": "23c52bb8-51b7-41ab-823e-7320e7f67cf3"}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:00.792725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] validate_networks() for [('23c52bb8-51b7-41ab-823e-7320e7f67cf3', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:59:01.182246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:01.183183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:01.194637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:01.195674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:01.196533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:01.197448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:01.198120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:01.198854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:01.581447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:01.589398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1f19882-12ca-457c-aea7-7bb0482851b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.412481 Sep 19 11:59:01.590009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 108/208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:01 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:01.628049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:59:01.628576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:59:01.629043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:59:01.629459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:59:01.629911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:59:01.632050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:01.642262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:01.642748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:01.643185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:01.643913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:01.644368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:01.644792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:01.665681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Getting quotas for project b0aec947283643dd9dfdce33a7b2799e. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:59:01.670880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Getting quotas for user 828f876065e4413f9447efb451cb5371 and project b0aec947283643dd9dfdce33a7b2799e. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:59:01.684868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:59:01.687889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:59:01.736135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-baec85dd-7a21-49ab-8a16-890e894ee0bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015707 Sep 19 11:59:01.737299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 101/209] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 11:59:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:59:01.757812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8d70dab-3407-4165-a3d4-a2eff6961623 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:01.757812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8d70dab-3407-4165-a3d4-a2eff6961623 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:01.863673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8d70dab-3407-4165-a3d4-a2eff6961623 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:01.872183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8d70dab-3407-4165-a3d4-a2eff6961623 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1219 microversion: 2.1 time: 0.119089 Sep 19 11:59:01.889506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 109/210] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:01 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:02.612337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:02.612952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:02.621741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:02.622269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:02.622709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:02.623915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:02.624376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:02.624806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:02.825605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:02.835451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-03c28243-69b1-40c5-ba05-20f936347c43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.227019 Sep 19 11:59:02.837803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 102/211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:02 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:02.897571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:02.898927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:02.906035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:02.906531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:02.907161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:02.907874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:02.908672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:02.909107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:02.976282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:02.985078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-559f8e20-d8d3-4739-83d9-d9081e220a91 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1223 microversion: 2.1 time: 0.091796 Sep 19 11:59:02.985644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 110/212] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:02 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:03.859113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:03.859852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:03.866222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:03.866785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:03.867221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:03.867921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:03.868371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:03.868795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:04.005424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:04.008756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:04.009367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:04.019059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d608925e-0e09-40bc-ab83-c9df5a064092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.164086 Sep 19 11:59:04.020984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 103/213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:03 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:04.022027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:04.022604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:04.023185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:04.024027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:04.024587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:04.025114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:04.103783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:04.130459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c380cc36-6794-4797-adc5-5c5660bc26ad tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1223 microversion: 2.1 time: 0.125730 Sep 19 11:59:04.146087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 111/214] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:04 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:05.045613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:05.046436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:05.054203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:05.055073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:05.055611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:05.056903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:05.057442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:05.057964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:05.160789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:05.161605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:05.164681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=46 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:05.168837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:05.169389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:05.170497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:05.171289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:05.171821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:05.172258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:05.236053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:05.244364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9d55ddf-3eaf-4a9c-a2be-cbec2f06d196 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.204409 Sep 19 11:59:05.244945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 104/215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:05 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:05.257046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:05.268446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85b3c9e7-ae24-4f62-88d8-a7ebf355d827 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1271 microversion: 2.1 time: 0.112565 Sep 19 11:59:05.269221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 112/216] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:05 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:06.267537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:06.268303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:06.275862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:06.276461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:06.276949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:06.277729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:06.278285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:06.278783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:06.293421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:06.294758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:06.301852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:06.302684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:06.303484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:06.304544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:06.304961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:06.305744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:06.511389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:06.524322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b276f689-6984-4434-8f90-36942fa42725 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.260678 Sep 19 11:59:06.536470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 105/217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:06 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:06.540939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:06.559194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48f389c7-9570-4822-bace-82a75f688aa7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1319 microversion: 2.1 time: 0.269275 Sep 19 11:59:06.559884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 113/218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:06 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:07.126729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-6ea98bb0-314d-4f33-a582-091b1f850e89 req-4fddbc40-3ea7-4200-9b82-8de3f7eb92bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c0c3240-7b50-4ad9-b795-cc28b647fb9a", "tag": "a66a2633-13ef-485d-9adf-b59e2dcf5548"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:07.139507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6ea98bb0-314d-4f33-a582-091b1f850e89 req-4fddbc40-3ea7-4200-9b82-8de3f7eb92bc service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:07.141631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6ea98bb0-314d-4f33-a582-091b1f850e89 req-4fddbc40-3ea7-4200-9b82-8de3f7eb92bc service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:07.143579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6ea98bb0-314d-4f33-a582-091b1f850e89 req-4fddbc40-3ea7-4200-9b82-8de3f7eb92bc service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:07.179246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-6ea98bb0-314d-4f33-a582-091b1f850e89 req-4fddbc40-3ea7-4200-9b82-8de3f7eb92bc service nova] Creating event network-changed:a66a2633-13ef-485d-9adf-b59e2dcf5548 for instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a on hv-cinder-85829 Sep 19 11:59:07.183230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-6ea98bb0-314d-4f33-a582-091b1f850e89 req-4fddbc40-3ea7-4200-9b82-8de3f7eb92bc service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063648 Sep 19 11:59:07.194176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 106/219] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:59:07.558973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:07.559667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:07.573369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:07.574142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:07.574882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:07.575737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:07.577848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:07.578305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:07.591248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:07.591985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:07.604631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:07.607783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:07.608373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:07.609115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:07.610895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:07.611331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:07.835848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:07.843500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:07.862541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-014e134e-6b10-4469-97f4-1a5b61baa239 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.302037 Sep 19 11:59:07.864103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 114/220] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:07 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:07.874856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:07.886889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-52e22a73-51ff-4a76-8208-b281c6ad4d51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1319 microversion: 2.1 time: 0.302051 Sep 19 11:59:07.887654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 107/221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:07 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:08.894018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:08.894018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:08.908847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:08.911434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:08.912619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:08.919440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:08.923670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:08.924652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:08.926680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:08.927210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:08.927657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:08.928382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:08.928993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:08.933328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:08.942024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:08.942616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:08.971876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:09.398740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:09.406571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f7d9112-f483-4fe6-b197-901e8b9a49ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.525856 Sep 19 11:59:09.421196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:09.429505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bc2c1604-0f56-4e83-9260-100d3f3dde6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1319 microversion: 2.1 time: 0.521778 Sep 19 11:59:09.436411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 115/222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:08 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:09.438260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 108/223] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:08 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1319 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:10.434466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:10.435136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:10.452191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:10.452191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:10.452607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:10.455185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:10.456152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:10.456960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:10.457471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:10.459659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:10.464700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:10.473159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:10.473745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:10.478351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:10.483315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:10.486086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:10.840309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:10.848024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d53c6610-f6e1-4804-9877-85194ec77788 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1319 microversion: 2.1 time: 0.398788 Sep 19 11:59:10.851609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 116/224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:10 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:10.915157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:10.926844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0ecac15c-eb18-4dd0-b05f-16acad6d81cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.497530 Sep 19 11:59:10.927437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 109/225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:10 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:11.880825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:11.884226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:11.885107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-3b446c53-5868-45e4-8cf3-83df5c36b665 req-496e6487-a358-4d0e-919f-ce0e05f3b69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0c3240-7b50-4ad9-b795-cc28b647fb9a", "name": "network-vif-plugged", "status": "completed", "tag": "a66a2633-13ef-485d-9adf-b59e2dcf5548"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:11.903276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.903575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.906839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:11.913678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:11.915824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:11.916284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:11.918231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:11.918772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:11.921268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3b446c53-5868-45e4-8cf3-83df5c36b665 req-496e6487-a358-4d0e-919f-ce0e05f3b69e service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:11.921746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3b446c53-5868-45e4-8cf3-83df5c36b665 req-496e6487-a358-4d0e-919f-ce0e05f3b69e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:11.922070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:11.923484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3b446c53-5868-45e4-8cf3-83df5c36b665 req-496e6487-a358-4d0e-919f-ce0e05f3b69e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:11.951570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-3b446c53-5868-45e4-8cf3-83df5c36b665 req-496e6487-a358-4d0e-919f-ce0e05f3b69e service nova] Creating event network-vif-plugged:a66a2633-13ef-485d-9adf-b59e2dcf5548 for instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a on hv-cinder-85829 Sep 19 11:59:11.959950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-3b446c53-5868-45e4-8cf3-83df5c36b665 req-496e6487-a358-4d0e-919f-ce0e05f3b69e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086965 Sep 19 11:59:11.960563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 117/226] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:59:11.972448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:11.973308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:11.986271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:11.986559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:11.987875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:11.988756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:11.989374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:11.990199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:12.278867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:12.283380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:12.290522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-43caed36-d942-4676-a54b-28229772d854 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1319 microversion: 2.1 time: 0.413582 Sep 19 11:59:12.301786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-048ace81-a008-4698-9890-1971aa4b7d27 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.329702 Sep 19 11:59:12.301786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 118/227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:11 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:12.303389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 110/228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:11 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:13.314158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:13.314771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:13.316131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:13.316886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:13.322272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:13.323620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:13.323745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:13.324046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:13.324406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:13.324786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:13.325012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:13.325217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:13.325535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:13.325676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:13.326548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:13.327125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:13.550871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:13.553140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:13.561720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c65f53f-6590-4046-afe3-dcacf9abc772 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.251286 Sep 19 11:59:13.563599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 119/229] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:13 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:13.573690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0f09172b-ccbd-42da-ae07-f4469f7ce89b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1319 microversion: 2.1 time: 0.259386 Sep 19 11:59:13.574719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 111/230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:13 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:14.586467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:14.587840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:14.599892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:14.600553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:14.612001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:14.612430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:14.613351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:14.614020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:14.614914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:14.615753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:14.617179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:14.617448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:14.619095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:14.634132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:14.634132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:14.634132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:14.937165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:14.950759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0a8d7069-fc21-45ae-bbc2-466917adb7fd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1509 microversion: 2.1 time: 0.355744 Sep 19 11:59:14.956170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 112/231] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:14 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:14.956821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:14.965148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcb0a7d0-6fe9-4270-b4b5-3bfb281a3044 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.383325 Sep 19 11:59:14.965705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 120/232] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:14 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:15.992825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:15.994399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:16.004003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:16.005145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:16.006050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:16.007210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:16.007796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:16.008476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:16.230780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:16.242979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63bfccc3-3aa1-4f13-8eaf-246e63fbe937 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.255889 Sep 19 11:59:16.244098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 113/233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:15 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:17.266998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:17.267724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:17.274259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:17.274753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:17.275349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:17.276199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:17.276813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:17.277397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:17.413002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:17.421500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a543574-46da-457b-a8cc-f2e3fd87a0b8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.158392 Sep 19 11:59:17.422116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 121/234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:17 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:17.816080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1485139338", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:17.872987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] validate_networks() for None {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:59:18.434737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:59:18.435159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:59:18.436249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:59:18.436653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:59:18.437102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:59:18.449238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:18.449832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:18.450148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:18.450578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:18.451333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:18.451770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:18.451896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:18.452193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:18.465568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:18.466965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:18.467537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:18.468268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:18.468967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:18.471539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:18.476568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Getting quotas for project c448b1e7eabe49799305a64b986d85eb. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:59:18.477079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Getting quotas for user 2a3739adb8b249f88dc7911ab82e48ba and project c448b1e7eabe49799305a64b986d85eb. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:59:18.490187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:59:18.492584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:59:18.545507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dc99ac01-e3dc-49f8-90a9-035be13f225c tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733968 Sep 19 11:59:18.546710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 114/235] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 11:59:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:59:18.560853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5378e7e0-1221-4772-9f50-36b3d5f6dc55 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:18.561904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5378e7e0-1221-4772-9f50-36b3d5f6dc55 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:18.643699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5378e7e0-1221-4772-9f50-36b3d5f6dc55 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:18.651653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5378e7e0-1221-4772-9f50-36b3d5f6dc55 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1215 microversion: 2.1 time: 0.096054 Sep 19 11:59:18.652564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 115/236] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:18 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:18.691395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:18.700141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acacd015-3d9d-4605-b18a-7bbdb0c66a59 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1520 microversion: 2.1 time: 0.256022 Sep 19 11:59:18.700707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 122/237] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:18 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:19.677133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:19.678762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:19.686563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:19.687290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:19.687891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:19.688744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:19.689342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:19.689924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:19.726259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:19.726699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:19.734898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:19.735843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:19.736535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:19.737912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:19.739123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:19.739735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:19.780443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:19.788368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a151ab26-32f9-4c8c-9385-6209998cdf4a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1267 microversion: 2.1 time: 0.115958 Sep 19 11:59:19.803758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 116/238] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:19 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:19.946973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:19.956409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db923fac-b8d2-4ba6-9a51-dd168dc9800c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1500 microversion: 2.1 time: 0.236574 Sep 19 11:59:19.957162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 123/239] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:19 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1500 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:19.980022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:19.980965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:19.988804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:19.989300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:19.989743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:19.990517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:19.991162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:19.991591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:20.192345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:20.217351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0f39e9e4-f898-428d-accd-d19aa14059e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1515 microversion: 2.1 time: 0.241447 Sep 19 11:59:20.220945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 117/240] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:19 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:20.815888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:20.817136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:20.827615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:20.828484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:20.829154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:20.830117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:20.834381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:20.834945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:20.930304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:20.941448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fff89f71-bdba-46c3-8a31-35bc4ba014a0 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1275 microversion: 2.1 time: 0.129842 Sep 19 11:59:20.943183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 124/241] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:20 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:21.824260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:21.828103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:21.836640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:21.837622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:21.838373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:21.839593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:21.840270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:21.841064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:21.871047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lazy-loading 'flavor' on Instance uuid 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:59:21.967458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:21.968065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:21.989339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:21.989860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:21.990777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:21.991358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:21.992827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:21.993266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:22.030256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0290909e-220c-4a0b-9e41-88e844fdb1da tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88/action" status: 200 len: 32 microversion: 2.1 time: 0.211309 Sep 19 11:59:22.036823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 118/242] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 11:59:21 2022] POST /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:59:22.058042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:22.062630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:22.092052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:22.094781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:22.097273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:22.098393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:22.099389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:22.100516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:22.387382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:22.402450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0e9d73c-9aa5-49d8-ba16-a14bfd451c9a tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1315 microversion: 2.1 time: 0.439831 Sep 19 11:59:22.409052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 125/243] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:21 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:22.421031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:22.450772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-939049b7-e277-45f3-aff4-b7fa9dff94de tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.412049 Sep 19 11:59:22.451885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 119/244] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:22 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:23.425673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-7a07a2ed-1492-4bef-86c6-4c05ff8325b2 req-01fda1ed-bd45-4bc7-b6a4-6e657c872475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc8d07ac-f2bb-4638-9a67-4b76fa291a20", "tag": "d3215f98-d1ba-4f9b-804d-c7d4e09b3f02"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:23.431586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:23.433120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:23.443395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:23.444511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:23.446932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:23.448048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:23.449067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:23.450648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:23.460886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7a07a2ed-1492-4bef-86c6-4c05ff8325b2 req-01fda1ed-bd45-4bc7-b6a4-6e657c872475 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:23.461400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7a07a2ed-1492-4bef-86c6-4c05ff8325b2 req-01fda1ed-bd45-4bc7-b6a4-6e657c872475 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:23.462427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7a07a2ed-1492-4bef-86c6-4c05ff8325b2 req-01fda1ed-bd45-4bc7-b6a4-6e657c872475 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:23.495968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-7a07a2ed-1492-4bef-86c6-4c05ff8325b2 req-01fda1ed-bd45-4bc7-b6a4-6e657c872475 service nova] Creating event network-changed:d3215f98-d1ba-4f9b-804d-c7d4e09b3f02 for instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 on hv-cinder-85829 Sep 19 11:59:23.508865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-7a07a2ed-1492-4bef-86c6-4c05ff8325b2 req-01fda1ed-bd45-4bc7-b6a4-6e657c872475 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091420 Sep 19 11:59:23.512659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 126/245] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:59:23.528594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:23.533465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:23.562068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:23.562426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:23.564289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:23.565555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:23.566741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:23.569095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:23.704178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:23.726233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-171ef6e5-137a-4a65-b2cf-154b0b59b170 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1315 microversion: 2.1 time: 0.300111 Sep 19 11:59:23.728709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 120/246] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:23 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:23.871787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:23.882581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b0bb43b-4935-4978-b603-fbb50d4a2729 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.367148 Sep 19 11:59:23.883334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 127/247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:23 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:24.754997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:24.755621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:24.763116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:24.764248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:24.764248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:24.764750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:24.765241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:24.765688 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:24.910057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:24.911004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:24.912045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:24.921004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:24.921791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:24.922458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:24.923490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:24.924104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:24.924714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:24.924833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a5c1f94-8b45-4f37-ad1c-ac7838b194e1 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1315 microversion: 2.1 time: 0.173581 Sep 19 11:59:24.925522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 121/248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:24 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:25.080157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:25.090027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97faa5b1-ed1a-4a22-972d-4d307c929e4d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.184455 Sep 19 11:59:25.091784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 128/249] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:24 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:25.948742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:25.949810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:25.957183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:25.958008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:25.958650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:25.959576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:25.960085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:25.960818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:26.117528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:26.118432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:26.124872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:26.125474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:26.126011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:26.126963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:26.128454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:26.128917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:26.226657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:26.236657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-13a38abb-ef30-4482-8f4a-553076d42b45 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1315 microversion: 2.1 time: 0.292278 Sep 19 11:59:26.242025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 122/250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:25 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:26.367348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:26.379152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74a16465-8f7d-4fc2-a5e3-32b0994e6035 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.266422 Sep 19 11:59:26.394709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 129/251] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:26 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:27.264552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:27.265780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:27.273517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:27.274050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:27.275264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:27.276531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:27.282255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:27.283124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:27.402964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:27.403570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:27.410329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:27.410810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:27.411418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:27.412109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:27.412585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:27.413003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:27.448146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:27.458190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe84dabe-e0a3-4f58-a6e1-88965181274e tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1315 microversion: 2.1 time: 0.197797 Sep 19 11:59:27.459060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 123/252] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:27 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:27.574745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:27.588558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1071a68e-3e87-41d1-acac-0460fc9c58dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.186012 Sep 19 11:59:27.610630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 130/253] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:27 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:27.713690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-ec6ed483-14a0-4b5a-b1d7-116ae32c65a1 req-eb5c51c0-06c0-4638-91f5-b633f7cbe2af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8d07ac-f2bb-4638-9a67-4b76fa291a20", "name": "network-vif-plugged", "status": "completed", "tag": "d3215f98-d1ba-4f9b-804d-c7d4e09b3f02"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:27.725469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ec6ed483-14a0-4b5a-b1d7-116ae32c65a1 req-eb5c51c0-06c0-4638-91f5-b633f7cbe2af service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:27.726020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ec6ed483-14a0-4b5a-b1d7-116ae32c65a1 req-eb5c51c0-06c0-4638-91f5-b633f7cbe2af service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:27.726884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-ec6ed483-14a0-4b5a-b1d7-116ae32c65a1 req-eb5c51c0-06c0-4638-91f5-b633f7cbe2af service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:27.737738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:27.738677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:27.740481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-ec6ed483-14a0-4b5a-b1d7-116ae32c65a1 req-eb5c51c0-06c0-4638-91f5-b633f7cbe2af service nova] Creating event network-vif-plugged:d3215f98-d1ba-4f9b-804d-c7d4e09b3f02 for instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 on hv-cinder-85829 Sep 19 11:59:27.747742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-ec6ed483-14a0-4b5a-b1d7-116ae32c65a1 req-eb5c51c0-06c0-4638-91f5-b633f7cbe2af service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038370 Sep 19 11:59:27.748974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 124/254] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:59:27.751877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:27.752603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:27.753183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:27.754222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:27.754873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:27.755444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:27.807407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37e092cd-4b19-4bf0-a6ec-e4cff43587e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/ips" status: 200 len: 146 microversion: 2.1 time: 0.074175 Sep 19 11:59:27.808789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 131/255] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 11:59:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:59:28.479126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:28.483751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:28.484520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:28.494430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:28.494914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:28.495423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:28.496115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:28.496562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:28.496990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:28.515831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:28.618370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:28.619115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:28.625494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:28.626024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:28.626464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:28.627166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:28.627621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:28.628047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:28.632629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:28.640464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d2431adb-9c1d-4728-83de-a872856eda86 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1315 microversion: 2.1 time: 0.162702 Sep 19 11:59:28.641056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 125/256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:28 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:28.743049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:28.743557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:28.745401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=8 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:28.750814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:28.751292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:28.751720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:28.752408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:28.752950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:28.753452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:28.767149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:28.775157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d39ca57f-8ca7-4f17-a3cf-d9f2031a06e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.161386 Sep 19 11:59:28.775827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 132/257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:28 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:28.778061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-620073d2-b700-4a8b-81f2-dc63e19b23fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/ips" status: 200 len: 151 microversion: 2.20 time: 0.038791 Sep 19 11:59:28.779286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 126/258] 10.222.0.88 () {60 vars in 1289 bytes} [Mon Sep 19 11:59:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:59:29.665307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:29.666004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:29.672579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:29.673109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:29.673727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:29.674657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:29.675360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:29.675765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:29.680680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:29.801628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:29.802295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:29.814938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:29.818640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:29.819403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:29.820553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:29.821531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:29.822668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:29.889803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:29.898806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9628dd80-11e4-4632-84c4-3b7cbde5ed95 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1465 microversion: 2.1 time: 0.238554 Sep 19 11:59:29.913323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 133/259] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:29 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1465 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:30.006012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:30.006777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:30.015545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:30.016115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:30.016556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:30.024999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:30.025489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:30.026017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:30.064918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:59:30.080236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:30.088906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6209cf0-1018-4cd1-8e48-79338de039a3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.291698 Sep 19 11:59:30.089747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 127/260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:29 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:30.217198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e961f3ba-b756-45fe-aaac-f876855b40fc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "DELETE /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 204 len: 0 microversion: 2.1 time: 0.214427 Sep 19 11:59:30.218091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 134/261] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 11:59:30 2022] DELETE /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 11:59:30.226847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:30.227464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:30.234601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:30.235095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:30.235531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:30.236300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:30.236759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:30.237397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:30.380969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:30.388745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-343199e6-7236-4afc-a547-2b034e6cc754 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1471 microversion: 2.1 time: 0.166079 Sep 19 11:59:30.389403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 128/262] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:30 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:31.118813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:31.120564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:31.128974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.129546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.130297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.131031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.131626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.132190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.315579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:31.324125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-727648a4-ebca-4ec5-b170-bd276d296de2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.209521 Sep 19 11:59:31.327612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 135/263] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:31 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:31.412919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:31.414117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:31.415067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:31.415306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:31.429047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.430279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.430947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.432325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.432998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.433395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.433707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.434244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.434420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.435839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.437016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.437557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.486689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lazy-loading 'flavor' on Instance uuid a51246d5-fe0a-4b24-a1d4-a580a28f16b2 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:59:31.715371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:31.733121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dbeeebda-eac1-467d-ba2c-a19ab58af4a5 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1471 microversion: 2.1 time: 0.322092 Sep 19 11:59:31.734133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 136/264] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:31 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:31.804841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb0ecc88-296e-4204-9194-b1768472266f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/action" status: 202 len: 0 microversion: 2.20 time: 0.396411 Sep 19 11:59:31.805498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 129/265] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Sep 19 11:59:31 2022] POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:59:31.816427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:31.817841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:31.825935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.826484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.827146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.828050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:31.828841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:31.829301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:31.983873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:32.001029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:32.002838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:32.004241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77150a65-b906-4215-ad90-335cab5b52b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.194166 Sep 19 11:59:32.021797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 137/266] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:59:32.352675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:32.353370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:32.355380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:32.360841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:32.361452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:32.361911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:32.362612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:32.363101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:32.363529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:32.505876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:32.514609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e64eaccf-323b-4e4b-be92-445ab622fead tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.166065 Sep 19 11:59:32.528553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 130/267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:32 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:32.756804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:32.757418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:32.763267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:32.763748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:32.764179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:32.764867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:32.765349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:32.765796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:32.907841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:32.915973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94931e20-1308-440f-ae8f-e36361b1d7c7 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1471 microversion: 2.1 time: 0.163126 Sep 19 11:59:32.916542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 138/268] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:32 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:33.032870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:33.033468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:33.039371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:33.039848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:33.040279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:33.040964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:33.041417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:33.041872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:33.217721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:33.226315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:33.227788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:33.228982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ace45e2-deea-4cb1-987f-30f6cd7b8088 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.200504 Sep 19 11:59:33.229540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 131/269] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:33.538383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:33.538985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:33.544885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:33.545362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:33.545819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:33.546632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:33.546989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:33.547407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:33.830019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:33.837736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-572025f8-7f92-4e0e-bf34-7e42167c1238 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.303196 Sep 19 11:59:33.838324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 139/270] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:33 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:33.939055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:33.939651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:33.946215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:33.946698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:33.947127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:33.947815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:33.948262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:33.948680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:34.083119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:34.091554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a58237e-f7a5-4158-bc50-88b228c02435 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1471 microversion: 2.1 time: 0.155856 Sep 19 11:59:34.092170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 132/271] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:33 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:34.254433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:34.255028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:34.262051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:34.262631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:34.263900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:34.264862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:34.265439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:34.265901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:34.406089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:34.414252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:34.415696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:34.416848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ed96b1d-4f69-49b6-a385-225111d287fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.166252 Sep 19 11:59:34.417401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 140/272] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:34.861039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:34.861653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:34.867696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:34.868182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:34.868623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:34.869342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:34.869786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:34.870220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:34.998780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:35.006517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-35cc7892-b4e8-44ba-87f9-22a1faf401b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.149954 Sep 19 11:59:35.007085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 133/273] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:34 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:35.116474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:35.117155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:35.123808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:35.124294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:35.124734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:35.125423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:35.125920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:35.126346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:35.276225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:35.284372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d30084f9-3a4f-4b37-9ec2-35b0ed85532b tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1471 microversion: 2.1 time: 0.171812 Sep 19 11:59:35.285141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 141/274] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:35 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:35.445313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:35.447344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:35.457433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:35.458401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:35.459122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:35.460121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:35.461137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:35.462376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:35.620459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:35.630243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:35.632070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:35.633683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0914aa17-2ee0-4b91-9e4a-cb87de8734d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.193303 Sep 19 11:59:35.634851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 134/275] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:36.032542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:36.033128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:36.038647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:36.040699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.041384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.041845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.042565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.043048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.043812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.199076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:36.212623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a87e21f4-8ec2-4cc3-af56-41a09682431e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.184322 Sep 19 11:59:36.218541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 142/276] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:36 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:36.309067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:36.310386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:36.318326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-fa1961c4-fb68-4acf-889a-7377c6aaf399 req-9f6b2e3d-4345-4785-99ab-fb8124fca336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc8d07ac-f2bb-4638-9a67-4b76fa291a20", "name": "network-vif-deleted", "tag": "d3215f98-d1ba-4f9b-804d-c7d4e09b3f02"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:36.321698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.324428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.327642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.328470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.328952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.330683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa1961c4-fb68-4acf-889a-7377c6aaf399 req-9f6b2e3d-4345-4785-99ab-fb8124fca336 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.331378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa1961c4-fb68-4acf-889a-7377c6aaf399 req-9f6b2e3d-4345-4785-99ab-fb8124fca336 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.331979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa1961c4-fb68-4acf-889a-7377c6aaf399 req-9f6b2e3d-4345-4785-99ab-fb8124fca336 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.334294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.349750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-fa1961c4-fb68-4acf-889a-7377c6aaf399 req-9f6b2e3d-4345-4785-99ab-fb8124fca336 service nova] Creating event network-vif-deleted:d3215f98-d1ba-4f9b-804d-c7d4e09b3f02 for instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 on hv-cinder-85829 Sep 19 11:59:36.369274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-fa1961c4-fb68-4acf-889a-7377c6aaf399 req-9f6b2e3d-4345-4785-99ab-fb8124fca336 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055575 Sep 19 11:59:36.370262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 143/277] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 11:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:59:36.381812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb8ac1c6-a244-4c13-b586-38ab3da884d3"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:36.385749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:36.394225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.395350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.396017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.397060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.397746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.398366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.486367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a3739adb8b249f88dc7911ab82e48ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c448b1e7eabe49799305a64b986d85eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:36.493258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7435c31d-4be3-476d-9974-75b8ca6925f4 tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 200 len: 1429 microversion: 2.1 time: 0.188665 Sep 19 11:59:36.497937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 135/278] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:36 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 1429 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:36.663769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:36.664447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:36.675266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.675807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.676291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.677011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:36.677475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:36.677928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:36.865320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:36.876972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:36.881016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:36.883061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e3c2913-b376-4fc9-b809-8147d12663aa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.223492 Sep 19 11:59:36.884148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 136/279] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:59:36.985295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66679e2c-0b7d-463b-995a-3d6c5e70198d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.608336 Sep 19 11:59:36.986040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 144/280] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 11:59:36 2022] POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 194 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:59:37.237693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:37.238213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:37.246822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:37.249909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:37.250371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:37.254573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:37.255122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:37.255572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:37.474824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:37.484110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2eb75f82-a757-4338-80cc-8ee285e26f6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.251361 Sep 19 11:59:37.484703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 137/281] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:37 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:37.521658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:37.522545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] [instance: cc8d07ac-f2bb-4638-9a67-4b76fa291a20] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:37.529978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:37.530671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:37.531442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:37.532484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:37.532940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:37.533634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:37.549619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] HTTP exception thrown: Instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 could not be found. Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Request method failure captured: Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 HTTP/1.1 Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFmTRzF3dHwVFoBgJ-6RpXIJFH3e5andLuNpondZe7-H1b_i9wB-tyKR3tP_nPVF7ImtRNg0YxNN4QiXrGZrf3QjovXznjzraMgOaVcn0u3_S0e5PtzKurHoKKmup2SQuROKPwM3LBnufPcIWRSTmzd2a14aRvmHoBuxLMsLaaZBm4o Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: c448b1e7eabe49799305a64b986d85eb Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-1917575080 Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:59:37.552016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c448b1e7eabe49799305a64b986d85eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/c448b1e7eabe49799305a64b986d85eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/c448b1e7eabe49799305a64b986d85eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_c448b1e7eabe49799305a64b986d85eb", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-1917575080 Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: c448b1e7eabe49799305a64b986d85eb Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-1917575080 Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-1917575080-project Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 2a3739adb8b249f88dc7911ab82e48ba Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-1917575080-project Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 could not be found. Sep 19 11:59:37.553316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'cc8d07ac-f2bb-4638-9a67-4b76fa291a20'} Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 could not be found. Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:59:37.554120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 could not be found. Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 could not be found. Sep 19 11:59:37.555319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:37.558321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] Returning 404 to user: Instance cc8d07ac-f2bb-4638-9a67-4b76fa291a20 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:59:37.559197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3c432bf-8aad-4602-b4d2-3e035ea0e0dc tempest-VolumesNegativeTest-1917575080 tempest-VolumesNegativeTest-1917575080-project] 10.222.0.88 "GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20" status: 404 len: 111 microversion: 2.1 time: 0.046230 Sep 19 11:59:37.560397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 145/282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:37 2022] GET /compute/v2.1/servers/cc8d07ac-f2bb-4638-9a67-4b76fa291a20 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:59:37.916313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:37.918514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:37.928602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:37.929300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:37.930236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:37.931243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:37.931668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:37.932184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:38.136538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:38.156558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:38.158365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:38.159880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b84e71d5-9447-4240-a6e9-f5e3b96a872f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.252517 Sep 19 11:59:38.160811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 138/283] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:38.511108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:38.511708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:38.518991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:38.519474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:38.519953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:38.520810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:38.521618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:38.522321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:38.659316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:38.667724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2b80826-a4b7-4bb5-bfff-47992a759831 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.160549 Sep 19 11:59:38.668811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 146/284] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:38 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:39.186425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:39.187838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:39.196182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:39.196677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:39.197113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:39.198135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:39.198591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:39.199198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:39.369696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:39.378901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:39.380880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:39.382315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6015e1d2-53bf-497f-a646-97eabb68b51e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.200893 Sep 19 11:59:39.382869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 139/285] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:59:39.693693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:39.694344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:39.701626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:39.702243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:39.702510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:39.703205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:39.703813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:39.704401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:39.848559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:39.856626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-84935c81-e20e-4037-8306-4976e28b3670 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.167295 Sep 19 11:59:39.857199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 147/286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:39 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:40.409001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:40.409615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:40.416406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:40.416906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:40.417342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:40.418095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:40.418552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:40.419021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:40.438834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:40.565615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:40.581016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:40.582996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:40.584436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-242a41aa-cb56-4347-aa2d-7c675ba1a08a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.179312 Sep 19 11:59:40.585388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 140/287] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:40.880285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:40.880851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:40.887811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:40.888299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:40.889311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:40.890038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:40.890704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:40.891127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:40.895432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:41.041353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:41.049686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8dceef5-976c-4aa3-8905-66d67ea99929 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.173252 Sep 19 11:59:41.050276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 148/288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:40 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:41.613778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:41.614754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:41.622901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:41.623560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:41.624040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:41.625059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:41.625634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:41.626164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:41.777883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:41.789263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:41.791207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:41.792388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29598c60-b591-4d67-a84c-9f8c56f00dce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.183824 Sep 19 11:59:41.792949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 141/289] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:42.074477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:42.075118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:42.082720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:42.083205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:42.083678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:42.084582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:42.085036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:42.085456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:42.224288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:42.233092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aeeb102d-7e74-44f1-afd7-1dc434154b0f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.162514 Sep 19 11:59:42.233654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 149/290] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:42 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:42.831191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:42.832174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:42.844609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:42.845730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:42.846508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:42.848027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:42.849051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:42.849932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:42.963389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e596de0-024c-4d0f-b3cc-35ef9edcb135", "device": "/dev/sdb"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:42.967138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:42.973177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:42.973656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:42.974132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:42.974836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:42.975286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:42.975710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:43.019140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:43.031734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:43.033915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:43.035375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5868b5e1-28ff-45d7-aeba-ef7938573330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.218703 Sep 19 11:59:43.036099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 142/291] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:43.259445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:43.260070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:43.266324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:43.266681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55a9bd3c-17aa-434c-9658-662c51ffae23 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "POST /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306500 Sep 19 11:59:43.267160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:43.267308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:43.268208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 150/292] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 11:59:42 2022] POST /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:59:43.268336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:43.268934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:43.269377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:43.445025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:43.452979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b8d0f88-0da6-449e-97d3-e42a7fe667a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.197948 Sep 19 11:59:43.453640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 143/293] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:43 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:44.064422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:44.065388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:44.073025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:44.073741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:44.074259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:44.075531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:44.076039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:44.076539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:44.228793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:44.237933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:44.239460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:44.240750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ca6fba1-0dab-4b7e-ac87-ffc19e978ea3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.180817 Sep 19 11:59:44.253798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 151/294] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:44.477004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:44.477562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:44.484394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:44.484881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:44.485366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:44.486130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:44.486575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:44.487001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:44.623665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:44.631397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da6c9510-8ff1-4582-adfe-d59965dda43c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.158461 Sep 19 11:59:44.632401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 144/295] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:44 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:45.270613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:45.271400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:45.278644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:45.279207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:45.279714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:45.284529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:45.285137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:45.285564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:45.450616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:45.459286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:45.462235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:45.464086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ecfef605-8c68-4f33-b8f7-419c6f7464b1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.200075 Sep 19 11:59:45.465203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 152/296] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:45.655248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:45.656066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:45.663122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:45.663617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:45.664219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:45.665163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:45.665828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:45.666415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:45.869729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:45.878794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17808b59-35a9-43b3-aa90-5bf7e69fa0b9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.228193 Sep 19 11:59:45.880288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 145/297] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:45 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:46.496494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:46.498869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:46.508198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:46.509081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:46.509947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:46.511122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:46.511602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:46.512038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:46.715166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:46.738339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:46.740021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:46.742482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e2a97ad-580e-4e6a-9c36-6604b52b9e28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.251090 Sep 19 11:59:46.746123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 153/298] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:46.908425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:46.911213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:46.920642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:46.921385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:46.922271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:46.924569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:46.925260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:46.925934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:47.133814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:47.144682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61f05488-f268-431c-a130-04ae203c20ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.240262 Sep 19 11:59:47.145618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 146/299] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:46 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:47.770397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:47.770931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:47.781322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:47.781549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:47.782276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:47.783023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:47.783477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:47.783893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:47.955369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:47.965231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:47.967012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:47.968177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c38057d3-1a73-4e84-824f-1432ecdb15e1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.201899 Sep 19 11:59:47.968721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 154/300] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:48.173592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:48.174475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:48.181973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.182600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.183078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.183891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.184674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.185253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.368690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:48.381114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4dc79127-f86b-4d26-8892-e20033c3607f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1501 microversion: 2.1 time: 0.212700 Sep 19 11:59:48.385664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 147/301] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:48 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:48.404826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b904bd8-de21-4c8c-83b9-5c70f62b6cf1"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:48.407722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:48.414282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.414773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.415205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.415907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.416898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.416898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.443139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] HTTP exception thrown: Cannot 'attach_volume' instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 while it is in vm_state rescued Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Request method failure captured: Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: POST /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88/os-volume_attachments HTTP/1.1 Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 74 Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkzftjjoFvPkVIdmt_q2ZojFS3yvUWytkC41R4D0nbWIxVoZLDnG0zEE8dv7rMq9qDiofIsn_mcJI4tCBp3CvxSZCDS3AVWEmm5l75NvukVEvpBCmEidSCCYAgqp48zl0TtbgGJIdZT7b5-8Z6fJ32ElmxZj4lib-BhyWP0C8gklzE Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: bf7ef0ac87cb450f9320b8d3a313d942 Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 11:59:48.444827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bf7ef0ac87cb450f9320b8d3a313d942", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: bf7ef0ac87cb450f9320b8d3a313d942 Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-1616990579-project Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 11af9e7e3fed4bea9187dee0ebf27551 Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1616990579-project Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {"volumeAttachment": {"volumeId": "6b904bd8-de21-4c8c-83b9-5c70f62b6cf1"}} Sep 19 11:59:48.446424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Cannot 'attach_volume' instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 while it is in vm_state rescued Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88', 'body': {'volumeAttachment': {'volumeId': '6b904bd8-de21-4c8c-83b9-5c70f62b6cf1'}}} Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:59:48.447320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 while it is in vm_state rescued Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:59:48.448863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:59:48.450344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:59:48.450344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:59:48.450344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 while it is in vm_state rescued Sep 19 11:59:48.450344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 11:59:48.450344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Returning 409 to user: Cannot 'attach_volume' instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 while it is in vm_state rescued {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:59:48.450344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b647207e-5bc0-43d9-babd-fad67fe57393 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046562 Sep 19 11:59:48.450344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 155/302] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 11:59:48 2022] POST /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:59:48.456432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:48.457052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:48.464026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.464763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.465189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.465963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.466717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.467305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.538045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8e5ca0c-1ce2-4ba1-a924-9a13bff89fc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88/action" status: 202 len: 0 microversion: 2.1 time: 0.085339 Sep 19 11:59:48.538943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 148/303] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 11:59:48 2022] POST /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:59:48.547611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:48.548222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:48.554247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.554723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.555161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.555854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:48.556488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:48.556913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:48.710032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:48.724157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5285a8c8-6807-495f-8adf-8935bceeccf2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1509 microversion: 2.1 time: 0.180669 Sep 19 11:59:48.724989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 156/304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:48 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:48.997217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:49.001609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:49.007948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:49.008435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:49.009064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:49.010781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:49.011244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:49.011669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:49.216927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:49.225917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:49.227375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:49.228563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-382d35d0-aa26-460b-b8b1-c6817ec27c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.236811 Sep 19 11:59:49.229129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 149/305] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:49.750545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:49.751086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:49.758960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:49.759645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:49.760478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:49.761736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:49.762562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:49.762995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:49.909735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:49.917543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1fecfd6-be57-4c57-9f1d-e7cc4fdd5260 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1509 microversion: 2.1 time: 0.171103 Sep 19 11:59:49.918142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 157/306] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:49 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:50.208286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b8b85fa-780b-456f-9454-c91288ec26fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:50.215401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b8b85fa-780b-456f-9454-c91288ec26fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:50.215926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b8b85fa-780b-456f-9454-c91288ec26fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:50.216381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b8b85fa-780b-456f-9454-c91288ec26fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:50.259905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:50.260455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:50.266573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:50.267046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:50.267473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:50.268157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:50.268596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:50.269006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:50.276186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b8b85fa-780b-456f-9454-c91288ec26fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Going to try to stop instance {{(pid=120644) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 11:59:50.341351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b8b85fa-780b-456f-9454-c91288ec26fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/action" status: 202 len: 0 microversion: 2.1 time: 0.136092 Sep 19 11:59:50.342166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 150/307] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 11:59:50 2022] POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:59:50.350202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:50.350872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:50.357682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:50.358199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:50.358622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:50.359325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:50.359771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:50.360187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:50.453597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:50.469164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:50.470838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:50.472393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec8dc663-82b3-4eb7-8543-8346953c1d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.216433 Sep 19 11:59:50.472936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 158/308] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:59:50.744742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:50.754448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-24eaab94-47cf-4e67-937c-3f8ac2de44f5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.408238 Sep 19 11:59:50.755030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 151/309] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:50.943492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:50.944094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:50.951044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:50.951415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:50.951844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:50.952555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:50.952999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:50.953416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:51.088539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:51.096906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7cfc1d5-c055-4805-a4ca-8283584db4aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1509 microversion: 2.1 time: 0.157883 Sep 19 11:59:51.097487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 159/310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:50 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:51.503147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:51.503708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:51.510305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:51.511448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:51.511448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:51.512104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:51.512555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:51.512981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:51.655719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:51.663948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:51.665387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:51.666566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-317ee5f9-41e1-43c4-b728-f924606e3dc9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.167535 Sep 19 11:59:51.667126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 152/311] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:59:51.779431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:51.780105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:51.786489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:51.786980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:51.787414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:51.788124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:51.788580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:51.789016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:51.924169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:51.932548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8d5d133-7c16-4d0f-a474-8ab692085ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.157660 Sep 19 11:59:51.933114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 160/312] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:52.120461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:52.121072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:52.127348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:52.128242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:52.128867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:52.130123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:52.131034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:52.141743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:52.291347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:52.320469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5d16fc7b-aaad-48c8-a06d-8d7d7cb7e261 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1515 microversion: 2.1 time: 0.203757 Sep 19 11:59:52.321509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 153/313] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:52 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:52.693555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:52.694297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:52.702641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:52.703208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:52.703748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:52.705480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:52.706061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:52.706577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:52.848609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:52.857137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:52.858870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:52.860191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de4161c8-53f1-4a06-93ed-ef1ee2142ec5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.171487 Sep 19 11:59:52.873786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 161/314] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:52.957527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:52.958167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:52.964757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:52.965248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:52.965788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:52.966486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:52.966940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:52.967365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:53.152181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:53.161624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3de9fe46-fc00-4caf-a015-f32ddc1172fc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.208395 Sep 19 11:59:53.162367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 154/315] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:53.750909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-329cf1ee-f754-41d4-af4a-f12af8a3bfd5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'create', calling method: .version_select at 0x7f4ff626cf70>, body: {"keypair": {"name": "tempest-keypair-1991500285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhflJEy5R6kh0ydjk7ybnvBmfFtaBHqh6Yvcsn8DKEtSzlPpZ32lGagy9j/1kksOKSfibBeNfUQAf7dSEB9Sa3FN6X3Ah6kkuXFwAJzUK+lGeaDswxegeMAHR1pv/rDgA=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:53.768862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-329cf1ee-f754-41d4-af4a-f12af8a3bfd5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:59:53.773435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-329cf1ee-f754-41d4-af4a-f12af8a3bfd5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for user 11af9e7e3fed4bea9187dee0ebf27551 and project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:59:53.802757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-329cf1ee-f754-41d4-af4a-f12af8a3bfd5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056369 Sep 19 11:59:53.803474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 162/316] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 11:59:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:59:53.887609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:53.888279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:53.894457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:53.894929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:53.895357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:53.896118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:53.896567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:53.897032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:53.901469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:54.042991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:54.054976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:54.071764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:54.077347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aed99efe-46c3-41bc-a645-6960918c513b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.193386 Sep 19 11:59:54.078677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 155/317] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:54.192514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:54.193132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:54.199803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:54.200230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:54.200666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:54.201378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:54.202124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:54.202556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:54.401436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:54.419969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-301a868c-b74e-4da3-8065-87cdd4cf6333 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.231407 Sep 19 11:59:54.421412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 163/318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:55.128671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:55.129280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:55.136170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:55.136664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:55.137801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:55.138517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:55.138969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:55.139392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:55.353871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:55.365502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:55.367734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:55.369414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-141d81e6-f7cc-47a4-846c-d259127c447b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.244608 Sep 19 11:59:55.370023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 156/319] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:55.446330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:55.447690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:55.454763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:55.455252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:55.455681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:55.456464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:55.456914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:55.457329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:55.627076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:55.630481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1094345681", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0267ab88-2ebf-4472-8b38-39eacc9e993a"}], "security_groups": [{"name": "tempest-securitygroup--2035814765"}], "key_name": "tempest-keypair-1991500285", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:59:55.631062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:59:55.640191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e45d025-5b1e-4251-b85b-829bfa34329b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.197653 Sep 19 11:59:55.657293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 164/320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:59:56.400128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:56.401037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:56.410155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:56.410689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:56.411633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:56.412713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:56.413296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:56.414276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:56.596668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:56.612615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:56.612615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:56.612615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7597fc5-2203-45eb-bb07-6676aa607018 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1722 microversion: 2.20 time: 0.217629 Sep 19 11:59:56.613262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 165/321] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:59:56.665112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:56.665902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:56.673226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:56.673715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:56.674258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:56.675018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:56.675486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:56.675911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:56.816033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:56.825976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4796b773-9371-4ca5-a5a4-2b6e272fdc03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.165220 Sep 19 11:59:56.826585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 166/322] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:57.641725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:57.642368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:57.649862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:57.650358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:57.650790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:57.651493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:57.652105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:57.652361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:57.805837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:57.814738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:57.816212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:57.817397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20eac075-9dfc-4910-a7cf-1c0b1af826a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1743 microversion: 2.20 time: 0.180194 Sep 19 11:59:57.818002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 167/323] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:59:57.850284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:57.850695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:57.856627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:57.857113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:57.857555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:57.858280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:57.858733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:57.859160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:57.999228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:58.008599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49dfcf53-e526-4d85-a758-984f65b613a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.162347 Sep 19 11:59:58.009378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 168/324] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:59:58.846958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:58.847603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:58.854723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:58.855213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:58.855645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:58.856341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:58.856788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:58.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:59.002085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:59.010747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:59.012358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:59.013540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b5440a8-2449-4900-91b3-e0e9ab218b37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1743 microversion: 2.20 time: 0.170670 Sep 19 11:59:59.014312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 169/325] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 11:59:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:59:59.040579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:59:59.041320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:59:59.048373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:59.048862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:59.049399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:59.050249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:59:59.050821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:59:59.051367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Sep 19 11:59:59.054032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR sqlalchemy.pool.impl.QueuePool Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Exception ignored in: . at 0x7f4ff648f550> Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Traceback (most recent call last): Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: and _finalize_fairy(None, rec, pool, ref, echo, True), Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: connection_record.checkin() Sep 19 11:59:59.057341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Sep 19 11:59:59.058702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: pool.dispatch.checkin(connection, self) Sep 19 11:59:59.058702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Sep 19 11:59:59.058702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: fn(*args, **kw) Sep 19 11:59:59.058702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Sep 19 11:59:59.058702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: time.sleep(0) Sep 19 11:59:59.058702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Sep 19 11:59:59.063765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Sep 19 11:59:59.064005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: AssertionError: do not call blocking functions from the mainloop Sep 19 11:59:59.199467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:59:59.208296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10018ef8-8b20-46cd-afc4-5cdaf2eccd7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.171556 Sep 19 11:59:59.208892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 170/326] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 11:59:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:00.041620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:00.042775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:00.050404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:00.051212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:00.051933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:00.052332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:00.052873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:00.053291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:00.231430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:00.239953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:00.242151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:00.243738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38798d30-e895-4846-917d-7d88caea767d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1743 microversion: 2.20 time: 0.208366 Sep 19 12:00:00.262092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 171/327] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1743 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:00.267354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:00.268152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:00.274400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:00.275152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:00.275771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:00.276479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:00.276932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:00.277355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:00.453987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:00.462931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd556492-731f-474f-aab9-ff9dc2938809 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.199228 Sep 19 12:00:00.463467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 172/328] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:01.269456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:01.270296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:01.282046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:01.282046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:01.282046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:01.282466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:01.282896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:01.283482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:01.457983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:01.466918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:01.468418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:01.469599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-33a4951f-5c03-4d63-ada1-fd05fcd027d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1743 microversion: 2.20 time: 0.204521 Sep 19 12:00:01.470194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 173/329] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1743 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:01.474776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ae1ef9ed-de96-40ae-88c5-cac9ce504569 req-bbb8026f-9227-43a4-9d64-311075c624e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "name": "network-vif-plugged", "status": "completed", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:01.484555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ae1ef9ed-de96-40ae-88c5-cac9ce504569 req-bbb8026f-9227-43a4-9d64-311075c624e5 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:01.485269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ae1ef9ed-de96-40ae-88c5-cac9ce504569 req-bbb8026f-9227-43a4-9d64-311075c624e5 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:01.485698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ae1ef9ed-de96-40ae-88c5-cac9ce504569 req-bbb8026f-9227-43a4-9d64-311075c624e5 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:01.498439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ae1ef9ed-de96-40ae-88c5-cac9ce504569 req-bbb8026f-9227-43a4-9d64-311075c624e5 service nova] Creating event network-vif-plugged:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 12:00:01.503733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-ae1ef9ed-de96-40ae-88c5-cac9ce504569 req-bbb8026f-9227-43a4-9d64-311075c624e5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032359 Sep 19 12:00:01.504366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 174/330] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:01.509473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:01.510304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:01.516733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:01.517240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:01.517652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:01.518403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:01.518833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:01.519257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:01.665193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:01.674977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-267af6d8-9e5f-4cb8-b3a9-eecd937ba5ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.169060 Sep 19 12:00:01.675686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 175/331] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:01.830577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] validate_networks() for [('0267ab88-2ebf-4472-8b38-39eacc9e993a', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:00:02.253926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:00:02.254343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:00:02.254997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:00:02.255414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:00:02.255869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:00:02.269274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:02.269274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:02.269274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:02.269274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:02.269650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:02.269650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:02.286105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:00:02.290499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Getting quotas for user 11af9e7e3fed4bea9187dee0ebf27551 and project bf7ef0ac87cb450f9320b8d3a313d942. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:00:02.302569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:00:02.304872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:00:02.363550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3837b190-2999-4f74-b9ca-de080a55204d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.737227 Sep 19 12:00:02.364217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 157/332] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 11:59:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 6739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 12:00:02.375799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e87c5405-ef03-4f95-8f37-44f82456fa5b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:02.376406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e87c5405-ef03-4f95-8f37-44f82456fa5b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:02.459678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e87c5405-ef03-4f95-8f37-44f82456fa5b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:02.469965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e87c5405-ef03-4f95-8f37-44f82456fa5b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1246 microversion: 2.1 time: 0.098259 Sep 19 12:00:02.470861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 176/333] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:02 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:02.497334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:02.498365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:02.505082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:02.507910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:02.508798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:02.509267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:02.510735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:02.511265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:02.511868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:02.648859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:02.657929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:02.659479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:02.660763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a764cfe9-8e19-4c95-833f-def261d949ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1743 microversion: 2.20 time: 0.168235 Sep 19 12:00:02.661412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 158/334] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:02.698885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:02.700052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:02.706058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:02.706548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:02.706985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:02.707683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:02.708142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:02.708567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:02.846150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:02.854409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ddcbbf6b-f5d9-42cc-a92a-d73c8c23b79c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.159314 Sep 19 12:00:02.854903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 177/335] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:03.492460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:03.493351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:03.499467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:03.499960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:03.500389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:03.501083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:03.501536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:03.501985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:03.569311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:03.577484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6c57017e-6414-470b-89ca-2b67c88a9bed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1250 microversion: 2.1 time: 0.088856 Sep 19 12:00:03.578090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 159/336] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:03 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:03.689311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:03.689971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:03.696329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:03.696804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:03.697229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:03.697939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:03.698386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:03.698799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:03.829859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:03.838683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:03.840384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:03.841545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59d9d94a-970f-478d-a749-3ee93a955b50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1743 microversion: 2.20 time: 0.156121 Sep 19 12:00:03.842133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 178/337] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:03.878267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:03.878871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:03.885023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:03.885511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:03.886013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:03.886715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:03.887747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:03.888203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:04.020560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:04.029262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1e83b19f-75ed-4d6d-8155-f40cc553c74d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.154697 Sep 19 12:00:04.029727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 160/338] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:04.601716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:04.602349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:04.608794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:04.609275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:04.609952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:04.610655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:04.611102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:04.611522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:04.671338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:04.678948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65fd5aa1-d2a9-4b41-8169-58a2e9b68a45 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1250 microversion: 2.1 time: 0.081386 Sep 19 12:00:04.679517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 179/339] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:04 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:04.867115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:04.867724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:04.874434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:04.874928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:04.875365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:04.876081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:04.876530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:04.877152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:05.013109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:05.021449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:05.022916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:05.024061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a541eb54-0a1b-40fc-b096-9a71c40663bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1743 microversion: 2.20 time: 0.160870 Sep 19 12:00:05.024609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 161/340] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:05.055358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:05.056392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:05.063741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:05.065007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:05.065627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:05.066613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:05.067069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:05.067493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:05.229896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:05.238415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd14cae4-9ea7-492b-9543-0509b3fd7790 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.189033 Sep 19 12:00:05.239345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 180/341] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:05.707384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:05.713416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:05.739679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:05.740177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:05.740614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:05.741324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:05.741802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:05.742268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:05.870330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:05.879718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d0fc8060-9c3c-4358-97c7-87d230f35e52 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1306 microversion: 2.1 time: 0.176829 Sep 19 12:00:05.890580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 162/342] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:05 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1306 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:06.050797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:06.053099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:06.059210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:06.059814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:06.060123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:06.060888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:06.061319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:06.061843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:06.263484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:06.264104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:06.284238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:06.284833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:06.285378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:06.286312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:06.286877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:06.287389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:06.295526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:06.311275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:06.314256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:06.316644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcf4aab5-cd59-4d5e-a20f-4a440749efd7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.269445 Sep 19 12:00:06.317371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 181/343] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:06.503060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:06.518735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc777666-c74b-4ef8-b522-3f65c8d13e87 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.252299 Sep 19 12:00:06.522736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 163/344] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:06.906270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:06.907430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:06.917623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:06.921094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:06.921805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:06.922529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:06.923953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:06.924719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:06.925796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:07.202861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:07.222321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42f4c81f-94c9-4aac-9092-f3fff7400bee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.321204 Sep 19 12:00:07.226457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 182/345] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:06 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:07.347536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:07.348689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:07.358111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:07.359714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:07.360444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:07.361946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:07.362964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:07.363682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:07.552919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:07.553541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:07.576503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:07.577003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:07.577433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:07.578187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:07.589612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:07.590847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:07.606732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:07.791161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:07.807095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:07.812769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:07.838009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1936d050-8cf8-4a40-9401-363fd3758062 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.472759 Sep 19 12:00:07.854349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 164/346] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:07.899637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-56ad52b4-8585-4624-9f6e-fb96c6006c21 req-e00fc6f0-7127-4f6e-89f0-94b05c425903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce686f0f-5a79-48d6-8501-d6f8e781ad39", "tag": "dd4f044e-c20a-4016-921a-f989ecfd24b9"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:07.916211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-56ad52b4-8585-4624-9f6e-fb96c6006c21 req-e00fc6f0-7127-4f6e-89f0-94b05c425903 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:07.916748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-56ad52b4-8585-4624-9f6e-fb96c6006c21 req-e00fc6f0-7127-4f6e-89f0-94b05c425903 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:07.917191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-56ad52b4-8585-4624-9f6e-fb96c6006c21 req-e00fc6f0-7127-4f6e-89f0-94b05c425903 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:07.934157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-56ad52b4-8585-4624-9f6e-fb96c6006c21 req-e00fc6f0-7127-4f6e-89f0-94b05c425903 service nova] Creating event network-changed:dd4f044e-c20a-4016-921a-f989ecfd24b9 for instance ce686f0f-5a79-48d6-8501-d6f8e781ad39 on hv-cinder-85829 Sep 19 12:00:07.940667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-56ad52b4-8585-4624-9f6e-fb96c6006c21 req-e00fc6f0-7127-4f6e-89f0-94b05c425903 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092268 Sep 19 12:00:07.941544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 165/347] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:08.009152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:08.024980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65a646cb-7234-4bcc-8283-f87e152a85ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.478714 Sep 19 12:00:08.026060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 183/348] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:08.250858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:08.251815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:08.259508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:08.260436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:08.263138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:08.269081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:08.269583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:08.270058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:08.487576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:08.497551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e8b7ece-b76f-49e3-865e-dd2f60912a23 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.249606 Sep 19 12:00:08.498162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 166/349] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:08 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:08.867129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:08.878801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:08.891590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:08.894172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:08.894800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:08.895716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:08.896736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:08.897336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:09.050403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:09.051358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:09.058025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:09.064468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:09.065297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:09.066252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:09.066719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:09.067143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:09.104500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:09.113632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:09.120897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:09.127081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d11284b-042e-4343-9b3e-a73b1de99898 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.265125 Sep 19 12:00:09.127672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 184/350] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:09.282123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:09.294455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-234a2660-bcf8-4589-bb8e-d35f266d1b15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.246943 Sep 19 12:00:09.295984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 167/351] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:09.521372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:09.531464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:09.547426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:09.548333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:09.549228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:09.550257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:09.550889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:09.551537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:09.713517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:09.722670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7927514c-aded-4591-be27-0c9e4701616a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.205723 Sep 19 12:00:09.723460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 185/352] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:09 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:10.156790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:10.158097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:10.175572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:10.176160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:10.176602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:10.177312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:10.177800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:10.178220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:10.319221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:10.320089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:10.328214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:10.328978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:10.332641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:10.336120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:10.339503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:10.343246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:10.343994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:10.344603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:10.350890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:10.352107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c143c3c7-1764-4ac7-abcb-8484740fd430 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.199379 Sep 19 12:00:10.352665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 168/353] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:10.512275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:10.522082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24f53e0e-ca42-4bd1-996b-9ac8a88b7a30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.207180 Sep 19 12:00:10.545155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 186/354] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:10.749964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:10.750562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:10.756843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:10.757331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:10.766588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:10.767581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:10.768326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:10.768765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:10.941280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:10.955019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a505663b-81a1-4e89-8687-c76f6db2270a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.208642 Sep 19 12:00:10.956153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 169/355] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:10 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:11.384831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:11.386230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:11.393631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:11.394393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:11.394828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:11.395514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:11.395965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:11.396384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:11.557559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:11.561798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:11.570724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:11.575260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:11.576334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:11.587703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:11.590017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:11.591027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:11.592237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:11.592614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:11.595469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:11.597653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f85821f4-7edb-4086-bde0-ad353deb1372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.216862 Sep 19 12:00:11.617751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 187/356] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:11.773238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:11.782215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6eef21b3-8968-49c9-bcfb-18d92d462457 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.233657 Sep 19 12:00:11.783293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 170/357] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:11.979696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:11.980850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:11.987465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:11.987960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:11.988432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:11.989128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:11.989579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:11.990027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:12.145048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:12.156512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1d72256-3969-4577-8479-7208e0a19e68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.180714 Sep 19 12:00:12.157340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 188/358] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:11 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:12.645193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:12.645885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:12.648126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.649581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.680367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:12.681222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:12.687221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:12.688417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:12.689126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:12.689965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:12.809989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:12.811780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:12.819793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:12.838115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:12.838115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:12.838115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:12.846410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:12.846410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:12.846410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:13.099597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:13.109225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a98898f-a899-42c5-a3a0-3989ab4a2338 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1723 microversion: 2.1 time: 0.305815 Sep 19 12:00:13.110036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 189/359] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:13.127031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:13.142879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:13.144569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:13.146047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6be31dce-a6e2-482c-8802-0fff33259a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.506165 Sep 19 12:00:13.156254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 171/360] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:13.180375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:13.181089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:13.187491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:13.187979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:13.188468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:13.189180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:13.189635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:13.190092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:13.387647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:13.396354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88697bbb-4df7-4ab4-893c-5ea52d1cbede tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.220202 Sep 19 12:00:13.406337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 190/361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:13 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:14.135934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:14.137368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:14.149329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.153303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.153959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.154864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.155494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.155929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.175611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:14.176884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:14.188276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.192264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.192894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.193807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.196092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.197146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.437298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:14.450777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2fbdbbfd-f6c8-4159-8860-6410acd8368d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1700 microversion: 2.1 time: 0.318726 Sep 19 12:00:14.451367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 172/362] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1700 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:14.460821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:14.467744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:14.469530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:14.485908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:14.488436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:14.490503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3eecc0cf-29b0-4999-be1b-2dd914eeb05f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.318874 Sep 19 12:00:14.493089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 191/363] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:14.505539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bde4a1cc-2eea-4357-8ff8-2c1e43988f0f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:14.513045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.514305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.514943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.518658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.520036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.520718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.535068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde4a1cc-2eea-4357-8ff8-2c1e43988f0f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.535875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde4a1cc-2eea-4357-8ff8-2c1e43988f0f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.536355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde4a1cc-2eea-4357-8ff8-2c1e43988f0f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.540083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:14.673047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bde4a1cc-2eea-4357-8ff8-2c1e43988f0f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Going to try to start instance {{(pid=120643) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 12:00:14.767486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bde4a1cc-2eea-4357-8ff8-2c1e43988f0f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/action" status: 202 len: 0 microversion: 2.1 time: 0.272016 Sep 19 12:00:14.768429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 192/364] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 12:00:14 2022] POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:00:14.778202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:14.782633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:14.795809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.796324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.796756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:14.797481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:14.797975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:14.798400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:15.113838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:15.130733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9e4a499f-a896-4e41-b1a3-e3b17211a0f2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.675680 Sep 19 12:00:15.134375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 173/365] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:14 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:15.167570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:15.178250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a5f9932-3e07-46d4-b573-9421bd95a1d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1709 microversion: 2.1 time: 0.405452 Sep 19 12:00:15.184173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 193/366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1709 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:15.297488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:15.298103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:15.308128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:15.308748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:15.309591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:15.310551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:15.311203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:15.311876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:15.479478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lazy-loading 'services' on Instance uuid 2c0c3240-7b50-4ad9-b795-cc28b647fb9a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:00:15.529128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:15.529733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:15.536225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:15.536828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:15.537195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:15.537922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:15.538377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:15.538799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:15.698485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e22fe209-4ef4-4650-b429-060c73c3a8bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a/os-volume_attachments/4e596de0-024c-4d0f-b3cc-35ef9edcb135" status: 202 len: 0 microversion: 2.1 time: 0.406677 Sep 19 12:00:15.701188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 174/367] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:00:15 2022] DELETE /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a/os-volume_attachments/4e596de0-024c-4d0f-b3cc-35ef9edcb135 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:00:15.763436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:15.774606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:15.776042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:15.778194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2db245c-7aaa-41f8-97d8-b63eca34ab58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.253617 Sep 19 12:00:15.784131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 194/368] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:16.159136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:16.160403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:16.167259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:16.168690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:16.169158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:16.170577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:16.171068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:16.171497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:16.204467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:16.205795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:16.216640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:16.216794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:16.217451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:16.220118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:16.220869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:16.221752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:16.511293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:16.529703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f33aded-77e3-4ab2-ad58-024761aac167 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.375027 Sep 19 12:00:16.534573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 175/369] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:16 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:16.573447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:16.586486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f7ec603-ad71-406c-b4fb-03e5f92c7627 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1709 microversion: 2.1 time: 0.388460 Sep 19 12:00:16.587481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 195/370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1709 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:16.815899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:16.816620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:16.820047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ce531f05-dfd6-4cea-8fcf-1bec17286d81 req-c2550222-6176-41a1-8bbd-ea2a7ce33e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce686f0f-5a79-48d6-8501-d6f8e781ad39", "name": "network-vif-plugged", "status": "completed", "tag": "dd4f044e-c20a-4016-921a-f989ecfd24b9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:16.830315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:16.831166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:16.831798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:16.832689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:16.833295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:16.833910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:16.843659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ce531f05-dfd6-4cea-8fcf-1bec17286d81 req-c2550222-6176-41a1-8bbd-ea2a7ce33e4a service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:16.847739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ce531f05-dfd6-4cea-8fcf-1bec17286d81 req-c2550222-6176-41a1-8bbd-ea2a7ce33e4a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:16.848351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ce531f05-dfd6-4cea-8fcf-1bec17286d81 req-c2550222-6176-41a1-8bbd-ea2a7ce33e4a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:16.900013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ce531f05-dfd6-4cea-8fcf-1bec17286d81 req-c2550222-6176-41a1-8bbd-ea2a7ce33e4a service nova] Creating event network-vif-plugged:dd4f044e-c20a-4016-921a-f989ecfd24b9 for instance ce686f0f-5a79-48d6-8501-d6f8e781ad39 on hv-cinder-85829 Sep 19 12:00:16.908908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-ce531f05-dfd6-4cea-8fcf-1bec17286d81 req-c2550222-6176-41a1-8bbd-ea2a7ce33e4a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093217 Sep 19 12:00:16.909507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 196/371] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:00:17.051818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:17.063010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:17.064788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:17.066246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d7142ac7-ac0c-4dc9-8d3c-cc99eae69ccf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.254149 Sep 19 12:00:17.067149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 176/372] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:17.562064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:17.562731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:17.576407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:17.576890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:17.577324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:17.578048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:17.578501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:17.578915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:17.616949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:17.618130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:17.625846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:17.626668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:17.628118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:17.629578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:17.630632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:17.630775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:17.816069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:17.828835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-673dce13-21d8-46ce-9d28-0bdabf77c1fa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.272843 Sep 19 12:00:17.842111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 197/373] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:17 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:17.857629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:17.865896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12f9b754-eab4-49d0-b415-79b6cabf6fca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1713 microversion: 2.1 time: 0.252830 Sep 19 12:00:17.866565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 177/374] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1713 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:17.984012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:17.984496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:17.990233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:17.990703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:17.991127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:17.991807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:17.992256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:17.992673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:18.022362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:00:18.051248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:18.096051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:18.097146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:18.104362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:18.105189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:18.106509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:18.108319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:18.108932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:18.109472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:18.130461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e75c609-e72d-45a0-9127-4b76b06f8f16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 204 len: 0 microversion: 2.1 time: 0.149773 Sep 19 12:00:18.139483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 198/375] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:00:17 2022] DELETE /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:00:18.145353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:18.146186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:18.152493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:18.153101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:18.153594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:18.154371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:18.155014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:18.155612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:18.342911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:18.351435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:18.352890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:18.354103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d0145941-f06d-49ff-9b7f-c0c8a8494935 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1738 microversion: 2.20 time: 0.262076 Sep 19 12:00:18.354670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 178/376] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:18.371437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:18.379180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0d9157e-b391-49d4-bf52-7d81feb32b08 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1515 microversion: 2.1 time: 0.238255 Sep 19 12:00:18.379733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 199/377] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:18 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1515 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:18.854522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:18.855128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:18.861374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:18.861882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:18.862338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:18.863032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:18.863485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:18.863918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:18.996611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:19.005726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78640daa-4e12-4bb7-b4a7-a74837040eae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.155090 Sep 19 12:00:19.006338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 179/378] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:18 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:19.380912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:19.382598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:19.389316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:19.389848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:19.390273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:19.390969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:19.391422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:19.392079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:19.407798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:19.409281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:19.416082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:19.418535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:19.419625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:19.437734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:19.438924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:19.441006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:19.596639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:19.606575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:19.608074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:19.609307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4da9a926-0d8e-4937-ab73-863a0327bdaa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1720 microversion: 2.20 time: 0.232640 Sep 19 12:00:19.610221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 200/379] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:19.642235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:19.651406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da97aa11-c0a1-4e73-b041-0b21abd54113 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1515 microversion: 2.1 time: 0.247983 Sep 19 12:00:19.655029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 180/380] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:19 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:20.029143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:20.029796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:20.036101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:20.036604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:20.037037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:20.037809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:20.038386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:20.038864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:20.202062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:20.213911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c537c282-f550-42e2-a10d-a59299903441 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.189089 Sep 19 12:00:20.215853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 201/381] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:20 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:20.635327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:20.635929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:20.642352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:20.642838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:20.643268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:20.643953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:20.644396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:20.644810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:20.678052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:20.678720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:20.684940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:20.685409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:20.685863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:20.686557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:20.687005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:20.687423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:20.824495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:20.833603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:20.835267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:20.836460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ac9d620c-9200-4137-9c7c-b5f4bb1ce6be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1720 microversion: 2.20 time: 0.205245 Sep 19 12:00:20.837167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 181/382] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:20.856191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:20.864494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09977618-9a0f-437b-a063-1311b756fdcd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1515 microversion: 2.1 time: 0.190301 Sep 19 12:00:20.865052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 202/383] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:20 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:21.239758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:21.240356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:21.246969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:21.247481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:21.247912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:21.248596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:21.249045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:21.249463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:21.382742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:21.390251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f231c980-13a1-44d4-a679-0da02c9da451 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.155201 Sep 19 12:00:21.390812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 182/384] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:21 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:21.865506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:21.866236 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:21.876316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:21.876903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:21.877342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:21.878507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:21.879325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:21.880032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:21.888168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:21.889322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:21.896809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:21.897307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:21.897749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:21.898498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:21.898954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:21.899384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:22.067581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:22.076055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:22.077503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:22.078729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66eda232-a489-42ec-8969-c46ffff2edf0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1720 microversion: 2.20 time: 0.218217 Sep 19 12:00:22.079292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 203/385] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:22.088911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:22.098083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6686007a-3c43-48d4-8d74-55b6370ba1b1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1515 microversion: 2.1 time: 0.214386 Sep 19 12:00:22.098920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 183/386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:21 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:22.413326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:22.413901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:22.419863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:22.420346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:22.420777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:22.421467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:22.421942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:22.422363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:22.575049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:22.584749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5aa9d9c2-4cfb-4292-877b-500b5003617e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1372 microversion: 2.1 time: 0.175246 Sep 19 12:00:22.585374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 204/387] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:22 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:22.707265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-99599e06-fce7-42c8-b0e2-e690f562768b req-f126e8e8-03fb-44c1-8070-8bca78f8ca54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "name": "network-vif-unplugged", "status": "completed", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:22.718545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-99599e06-fce7-42c8-b0e2-e690f562768b req-f126e8e8-03fb-44c1-8070-8bca78f8ca54 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:22.719029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-99599e06-fce7-42c8-b0e2-e690f562768b req-f126e8e8-03fb-44c1-8070-8bca78f8ca54 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:22.719456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-99599e06-fce7-42c8-b0e2-e690f562768b req-f126e8e8-03fb-44c1-8070-8bca78f8ca54 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:22.731317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-99599e06-fce7-42c8-b0e2-e690f562768b req-f126e8e8-03fb-44c1-8070-8bca78f8ca54 service nova] Creating event network-vif-unplugged:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 12:00:22.736206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-99599e06-fce7-42c8-b0e2-e690f562768b req-f126e8e8-03fb-44c1-8070-8bca78f8ca54 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032593 Sep 19 12:00:22.736790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 184/388] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:23.104906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:23.106233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:23.113171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.113653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.114125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.114856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.115314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.115790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.122291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:23.123193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:23.138732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.139369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.139916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.140735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.141307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.142515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.327643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:23.334729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:23.336859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:23.338436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:23.339885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74b7eaff-93ee-480f-aef3-30e8d55eec59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1720 microversion: 2.20 time: 0.238873 Sep 19 12:00:23.344183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 205/389] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:23.344343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e087518f-dcaa-43db-bc90-343dc298f0ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1515 microversion: 2.1 time: 0.225767 Sep 19 12:00:23.344343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 185/390] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:23 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:23.607741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:23.608633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:23.614998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.615582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.616130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.616952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.617481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.618004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.780212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:23.788276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98fbb80a-7649-4a4e-be9c-da3e6a44d7c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1565 microversion: 2.1 time: 0.184376 Sep 19 12:00:23.788849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 206/391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:23 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:23.811813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:23.812408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:23.818668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.819157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.819785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.820494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:23.820953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:23.821380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:23.898811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-61b04e34-765c-45b1-86a5-772dcae20547 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091598 Sep 19 12:00:23.899504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 186/392] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Sep 19 12:00:23 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:24.369297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:24.370033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:24.374629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-f55651b6-6948-485c-8714-c4c5b3892df9 req-f2e94d31-9732-4ad1-b7a8-1fbd8c509fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c0c3240-7b50-4ad9-b795-cc28b647fb9a", "name": "network-vif-deleted", "tag": "a66a2633-13ef-485d-9adf-b59e2dcf5548"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:24.384196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:24.384698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:24.385135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:24.385869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:24.386405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:24.386834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:24.395790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f55651b6-6948-485c-8714-c4c5b3892df9 req-f2e94d31-9732-4ad1-b7a8-1fbd8c509fe0 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:24.396565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f55651b6-6948-485c-8714-c4c5b3892df9 req-f2e94d31-9732-4ad1-b7a8-1fbd8c509fe0 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:24.396986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f55651b6-6948-485c-8714-c4c5b3892df9 req-f2e94d31-9732-4ad1-b7a8-1fbd8c509fe0 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:24.409452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-f55651b6-6948-485c-8714-c4c5b3892df9 req-f2e94d31-9732-4ad1-b7a8-1fbd8c509fe0 service nova] Creating event network-vif-deleted:a66a2633-13ef-485d-9adf-b59e2dcf5548 for instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a on hv-cinder-85829 Sep 19 12:00:24.414945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-f55651b6-6948-485c-8714-c4c5b3892df9 req-f2e94d31-9732-4ad1-b7a8-1fbd8c509fe0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057933 Sep 19 12:00:24.415540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 207/393] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:24.421618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:24.422339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:24.428426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:24.428910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:24.429347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:24.430077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:24.430533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:24.430954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:24.515934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:24.523945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f959148-378c-4e87-a9fe-8b53a9423a05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1473 microversion: 2.1 time: 0.106637 Sep 19 12:00:24.524627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 208/394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:24 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1473 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:24.636933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:24.645375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:24.646988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:24.648295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92859054-77d8-4736-9935-4407bffa0984 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1720 microversion: 2.20 time: 0.285018 Sep 19 12:00:24.648923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 187/395] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1720 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:25.000532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e1c80ae9-5d46-411f-95de-9d639750ea23 req-2c852cc1-42d2-4dad-970a-80f5b61a44cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce686f0f-5a79-48d6-8501-d6f8e781ad39", "tag": "dd4f044e-c20a-4016-921a-f989ecfd24b9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:25.010071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e1c80ae9-5d46-411f-95de-9d639750ea23 req-2c852cc1-42d2-4dad-970a-80f5b61a44cb service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:25.010562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e1c80ae9-5d46-411f-95de-9d639750ea23 req-2c852cc1-42d2-4dad-970a-80f5b61a44cb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:25.010994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e1c80ae9-5d46-411f-95de-9d639750ea23 req-2c852cc1-42d2-4dad-970a-80f5b61a44cb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:25.022542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e1c80ae9-5d46-411f-95de-9d639750ea23 req-2c852cc1-42d2-4dad-970a-80f5b61a44cb service nova] Creating event network-changed:dd4f044e-c20a-4016-921a-f989ecfd24b9 for instance ce686f0f-5a79-48d6-8501-d6f8e781ad39 on hv-cinder-85829 Sep 19 12:00:25.027638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e1c80ae9-5d46-411f-95de-9d639750ea23 req-2c852cc1-42d2-4dad-970a-80f5b61a44cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032134 Sep 19 12:00:25.028300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 209/396] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:25.548691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:25.549383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:25.555889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:25.556381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:25.556840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:25.557515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:25.558052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:25.558481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:25.621181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:25.628978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88bd04fb-2057-46a2-b2f2-be8c8e36ae20 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1473 microversion: 2.1 time: 0.084112 Sep 19 12:00:25.629545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 188/397] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:25 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1473 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:25.675679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:25.676392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:25.683577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:25.684063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:25.684536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:25.685258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:25.685878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:25.686306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:25.825012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:25.833728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:25.835464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:25.836633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cfe4c2b-92c1-4b9e-b030-b8defcdbf2a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1720 microversion: 2.20 time: 0.165367 Sep 19 12:00:25.837197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 210/398] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:26.654710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:26.655329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:26.676258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:26.677071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:26.677715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:26.678739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:26.690770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:26.691567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:26.733918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:26.734676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:26.735275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:26.735892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lazy-loading 'fault' on Instance uuid 2c0c3240-7b50-4ad9-b795-cc28b647fb9a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:00:26.791197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:26.796675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:26.810673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-713b3f40-463d-479c-8d18-35b1e05184ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 200 len: 1309 microversion: 2.1 time: 0.159656 Sep 19 12:00:26.812205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 189/399] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:26 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:26.862801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:26.863528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:26.871782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:26.872367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:26.872872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:26.873943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:26.874263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:26.874681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.009646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:27.017940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:27.019445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:27.020622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae23f832-2871-4b58-b853-58c02d356227 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1723 microversion: 2.20 time: 0.162648 Sep 19 12:00:27.021171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 211/400] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:27.047257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d741d5f-580c-4790-91e4-6c782fc6ee46"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:27.049676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:27.059028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.059520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.059958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.060662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.061119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.061550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.365055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-40597a0b-c608-4bf4-859a-cb7953892fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322906 Sep 19 12:00:27.365657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 190/401] 10.222.0.88 () {62 vars in 1364 bytes} [Mon Sep 19 12:00:27 2022] POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:00:27.507970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:27.508617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:27.515622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.516111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.516552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.517274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.517735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.518352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.562559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 12:00:27.636670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46f94f22-06b8-417a-bcb4-6593c8be2fa6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/action" status: 202 len: 0 microversion: 2.20 time: 0.133054 Sep 19 12:00:27.637589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 212/402] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Sep 19 12:00:27 2022] POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:00:27.646451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:27.647114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:27.653730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.654269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.654706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.655419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.655936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.656282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.803413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:27.813387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:27.814965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:27.816787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f633f712-f18b-45b9-81d7-c760208b6d2f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1749 microversion: 2.20 time: 0.174834 Sep 19 12:00:27.817343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 191/403] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:27.838001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:27.838616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 2c0c3240-7b50-4ad9-b795-cc28b647fb9a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:27.846108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.846598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.847063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.847740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:27.848411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:27.848865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:27.870148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] HTTP exception thrown: Instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a could not be found. Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Request method failure captured: Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a HTTP/1.1 Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFl-75NQCcHR63u-5jFsud3ZnHWthOyW1l4eaIbDDO2tPZFuaomeqeC15sP-d0EkQYmmWjGX-c_J1BySqWiXA_xr_nuPWTQPxQIKu3fttfAKPncL2bvLzpKEKn6mPgX0zew_9nk4NBYDWtj9Koo5ZW_ihKC0z3cwrlVYY4J9ePbxyhY Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: b0aec947283643dd9dfdce33a7b2799e Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1018589187 Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:00:27.872165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b0aec947283643dd9dfdce33a7b2799e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/b0aec947283643dd9dfdce33a7b2799e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/b0aec947283643dd9dfdce33a7b2799e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_b0aec947283643dd9dfdce33a7b2799e", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotTestJSON-1018589187 Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: b0aec947283643dd9dfdce33a7b2799e Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1018589187 Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotTestJSON-1018589187-project Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 828f876065e4413f9447efb451cb5371 Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotTestJSON-1018589187-project Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a could not be found. Sep 19 12:00:27.873522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '2c0c3240-7b50-4ad9-b795-cc28b647fb9a'} Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a could not be found. Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:00:27.877935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a could not be found. Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a could not be found. Sep 19 12:00:27.879890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:00:27.881288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Returning 404 to user: Instance 2c0c3240-7b50-4ad9-b795-cc28b647fb9a could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:00:27.881288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b43e766-edd1-462f-a814-97b1c47f636d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a" status: 404 len: 111 microversion: 2.1 time: 0.042841 Sep 19 12:00:27.881288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 213/404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:27 2022] GET /compute/v2.1/servers/2c0c3240-7b50-4ad9-b795-cc28b647fb9a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:00:28.843959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:28.844561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:28.850634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:28.851111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:28.851541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:28.852227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:28.852670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:28.853086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:29.059524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:29.068754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:29.079694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:29.080907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4d4868c4-d514-48e0-8477-fa2d34c8e9ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1749 microversion: 2.20 time: 0.240880 Sep 19 12:00:29.081458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 192/405] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1749 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:30.109455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:30.110354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:30.117548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:30.118189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:30.118758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:30.119669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:30.120295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:30.120884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:30.304081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:30.313376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:30.314869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:30.316024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a27e1c9-a0ce-42c4-9de5-ff89ae25ce89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1749 microversion: 2.20 time: 0.211767 Sep 19 12:00:30.316710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 214/406] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1749 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:31.342665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:31.343534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:31.351723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:31.352617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:31.353283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:31.354305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:31.355811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:31.356568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:31.514646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:31.523964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:31.525801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:31.527577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d46772b-4703-4efa-8972-3540461fe10e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1751 microversion: 2.20 time: 0.189210 Sep 19 12:00:31.528227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 193/407] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:32.554948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:32.555644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:32.564725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:32.566741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:32.567199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:32.568662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:32.569339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:32.570084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:32.597570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:32.867072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:32.876591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:32.878068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:32.879241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fee155b9-b2fb-4258-b1fe-202b2077916c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.329104 Sep 19 12:00:32.894252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 215/408] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:33.906428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:33.907193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:33.910406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=74 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:33.915936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:33.916494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:33.916997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:33.917883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:33.918264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:33.918717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:34.165208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:34.176473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:34.177967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:34.179273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-daba72ba-43e0-4ca7-91f2-e406ab5cc8bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.276874 Sep 19 12:00:34.185093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 194/409] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:35.214882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:35.215496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:35.223195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:35.223758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:35.224431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:35.225357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:35.225919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:35.226507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:35.368355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:35.381090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:35.382573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:35.384535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d24c41f9-4563-459e-96fd-8e6027e86f09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.174404 Sep 19 12:00:35.385293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 216/410] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:35.999069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-456078907", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "networks": [{"uuid": "23c52bb8-51b7-41ab-823e-7320e7f67cf3"}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:36.062362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] validate_networks() for [('23c52bb8-51b7-41ab-823e-7320e7f67cf3', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:00:36.412340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:36.412962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:36.420223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:36.420719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:36.421186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:36.422012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:36.422473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:36.422904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:36.725596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:36.738279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:36.739749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:36.740947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fd5f482-1de9-4fea-9513-cf85086b265f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.333100 Sep 19 12:00:36.754583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 217/411] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:36.871650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:00:36.872298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:00:36.873089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:00:36.873722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:00:36.874438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:00:36.889618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:36.890242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:36.890788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:36.891610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:36.892292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:36.892827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:36.915994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Getting quotas for project b0aec947283643dd9dfdce33a7b2799e. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:00:36.921926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Getting quotas for user 828f876065e4413f9447efb451cb5371 and project b0aec947283643dd9dfdce33a7b2799e. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:00:36.951415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:00:36.953825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:00:37.025457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22a0a069-1250-4163-b685-7aa651a2a2ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030785 Sep 19 12:00:37.026603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 195/412] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:00:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:00:37.037204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3d510a9-717c-4aa9-ab0a-1cde608af952 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:37.037933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3d510a9-717c-4aa9-ab0a-1cde608af952 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:37.043471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:37.148506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3d510a9-717c-4aa9-ab0a-1cde608af952 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:37.156569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3d510a9-717c-4aa9-ab0a-1cde608af952 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1218 microversion: 2.1 time: 0.123131 Sep 19 12:00:37.157494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 218/413] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:37 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:37.769371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:37.774388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:37.784982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:37.785510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:37.786046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:37.787587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:37.788282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:37.789108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:37.968818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:37.980714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:37.984024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:37.985332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-617522ed-efb2-400a-a454-2ff65035af40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.220579 Sep 19 12:00:37.986692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 196/414] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:38.179809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:38.181156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:38.197578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:38.201301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:38.204248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:38.205374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:38.216538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:38.220632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:38.400723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:38.413058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a0d9ff2-8261-4c12-a665-8a7224eec4f9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1270 microversion: 2.1 time: 0.237169 Sep 19 12:00:38.420924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 219/415] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:38 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:39.015843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:39.017253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:39.025666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:39.027653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:39.028115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:39.028910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:39.029390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:39.029999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:39.330483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:39.343344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:39.348511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:39.349737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48b50a26-ee0b-4e83-b603-5ebee1108e67 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.337881 Sep 19 12:00:39.350326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 197/416] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:39.442908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:39.448099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:39.474383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:39.476888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:39.477653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:39.481602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:39.482995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:39.483664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:39.600174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:39.624965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7abe5a0-da4d-4a67-af9a-bf5ac1a00167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1270 microversion: 2.1 time: 0.185709 Sep 19 12:00:39.625944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 220/417] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:39 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:40.394714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:40.395443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:40.411754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:40.412737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:40.413198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:40.416511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:40.417152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:40.417753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:40.650573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:40.651662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:40.664897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:40.675869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:40.676369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:40.680917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:40.682556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:40.684525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:40.937223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:40.962272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2dc38661-c3c5-42ca-9f96-031d84423f79 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1270 microversion: 2.1 time: 0.315465 Sep 19 12:00:40.966109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 221/418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:40 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1270 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:40.970912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:40.994115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:41.006355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:41.010122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d181b64b-e9ee-4001-be1b-17696046e22f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.636680 Sep 19 12:00:41.013134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 198/419] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:41.990718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:41.993544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:42.016102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:42.016602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:42.017043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:42.017805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:42.018261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:42.018691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:42.047316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:42.047989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:42.084214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:42.086168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:42.088629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:42.092250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:42.094642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:42.095123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:42.192897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:42.216702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f8b4900-3a4d-435f-9a8c-ec74f7fc5954 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1288 microversion: 2.1 time: 0.230010 Sep 19 12:00:42.225153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 222/420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:41 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1288 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:42.502084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:42.518969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:42.522208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:42.528746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c897b949-d9e7-450b-a855-f628c9615012 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.483326 Sep 19 12:00:42.530727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 199/421] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:00:43.244793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:43.245531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:43.256717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:43.257216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:43.267253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:43.267445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:43.269203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:43.270601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:43.539078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:43.560450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b72ada5-8929-418f-8573-5e864ea8c242 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1276 microversion: 2.1 time: 0.319712 Sep 19 12:00:43.560902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:43.561404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 223/422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:43 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1276 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:43.561511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:43.571614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:43.572717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:43.574415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:43.575403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:43.576432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:43.577038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:43.886803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:43.915722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:43.919717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:43.922398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-121c6a2a-55cf-4722-95ff-502b55f83efd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.368437 Sep 19 12:00:43.925970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 200/423] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:44.597431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:44.598070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:44.615567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:44.616061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:44.616495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:44.629576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:44.632520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:44.634489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:44.764999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:44.791374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5b99f71-0a29-45c7-9e8c-22e7c83f6805 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1276 microversion: 2.1 time: 0.191092 Sep 19 12:00:44.792087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 224/424] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:44 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:44.955199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:44.955804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:44.976222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:44.977184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:44.977919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:44.979980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:44.980456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:44.982839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:45.410644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:45.428872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:45.432250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:45.434701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab2090e1-5a28-4bae-8d68-f141b5154ddf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.483326 Sep 19 12:00:45.442161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 201/425] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:45.820511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:45.821649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:45.835505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:45.836326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:45.838239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:45.846555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:45.848320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:45.851781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:45.953563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:45.971515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1497436-1cd4-4cb2-95b9-434aeee8f454 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1276 microversion: 2.1 time: 0.156507 Sep 19 12:00:45.974294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 225/426] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:45 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:46.185988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29f514c1-20ed-4633-9a09-134f1384749c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Action: 'create', calling method: .version_select at 0x7f4ff600ac10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2116099399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfD1Fih9xmR4vrouRdOx2xJgwQnA94EurHv8FZGfC/BJhuq1JMpTm9qDCx57RzgEfNYvzNMj5pSfD6KB2Sf+W7vSjxj0ZBkD9D0IavftWctg21DqyYodfhVSwQqwLddyQ=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:46.206443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-29f514c1-20ed-4633-9a09-134f1384749c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Getting quotas for project 2f7dd7174903460989484c1ab233208a. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:00:46.211395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-29f514c1-20ed-4633-9a09-134f1384749c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Getting quotas for user fc84618366b045658728196980072790 and project 2f7dd7174903460989484c1ab233208a. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:00:46.226216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [None req-29f514c1-20ed-4633-9a09-134f1384749c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [24db2afc-b0e2-4f1e-bb54-a75212366b90] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:00:46.477492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:46.478589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:46.488306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:46.488802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:46.489237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:46.489988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:46.490442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:46.490864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:46.700003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:46.710140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:46.711911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:46.714128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-964f215f-4dc1-49fe-addb-dd644ca06a45 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.240484 Sep 19 12:00:46.715814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 226/427] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:46.904346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:46.999652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:47.000930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:47.008338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:47.009112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:47.009700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:47.010700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:47.011314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:47.011881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:47.112189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:47.121602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27a092cc-4119-4e1e-88c5-5892f3620455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1276 microversion: 2.1 time: 0.126652 Sep 19 12:00:47.122209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 227/428] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:46 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:00:47.233634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [None req-29f514c1-20ed-4633-9a09-134f1384749c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [24db2afc-b0e2-4f1e-bb54-a75212366b90] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 42412. Sep 19 12:00:47.258131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29f514c1-20ed-4633-9a09-134f1384749c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.346184 Sep 19 12:00:47.260022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 202/429] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:00:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:00:47.744621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:47.745845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:47.747677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:47.752990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:47.753476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:47.753933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:47.754648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:47.755088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:47.755507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:47.946552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:47.955444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:47.957015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:47.958226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15dcbfd3-8e7d-40ef-8083-89e85fb81d88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.217648 Sep 19 12:00:47.958781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 228/430] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:48.149200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:48.149971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:48.157222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:48.157896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:48.158229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:48.158922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:48.159368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:48.159786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:48.226004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:48.234809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f1bd3ce8-6148-4310-b260-084448e4ecb7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1276 microversion: 2.1 time: 0.090014 Sep 19 12:00:48.235446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 203/431] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:48 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:48.985539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:48.986217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:48.999665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:49.000494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:49.001129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:49.002133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:49.002956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:49.003583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:49.188435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:49.198789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:49.200341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:49.201881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfc1d572-6cce-446f-8e79-5c403e494c3f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.220071 Sep 19 12:00:49.203006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 229/432] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:49.261997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:49.263351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:49.270280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:49.270790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:49.271235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:49.272076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:49.272536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:49.272965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:49.451124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:49.459006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-944cbcc4-4aab-44a2-be16-c7a5efc4901b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1318 microversion: 2.1 time: 0.203730 Sep 19 12:00:49.459581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 204/433] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:49 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:49.641355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-1bd900af-b62d-475f-b63a-3330598e0e1b req-36797af7-162f-41b8-bf11-ffe5fe302688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e8311d2-58be-42df-b177-55a98bebcb2e", "tag": "77fc5477-7847-499d-a893-472333c63a06"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:49.656198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1bd900af-b62d-475f-b63a-3330598e0e1b req-36797af7-162f-41b8-bf11-ffe5fe302688 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:49.658446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1bd900af-b62d-475f-b63a-3330598e0e1b req-36797af7-162f-41b8-bf11-ffe5fe302688 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:49.659195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-1bd900af-b62d-475f-b63a-3330598e0e1b req-36797af7-162f-41b8-bf11-ffe5fe302688 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:49.682998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-1bd900af-b62d-475f-b63a-3330598e0e1b req-36797af7-162f-41b8-bf11-ffe5fe302688 service nova] Creating event network-changed:77fc5477-7847-499d-a893-472333c63a06 for instance 6e8311d2-58be-42df-b177-55a98bebcb2e on hv-cinder-85829 Sep 19 12:00:49.690040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-1bd900af-b62d-475f-b63a-3330598e0e1b req-36797af7-162f-41b8-bf11-ffe5fe302688 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051975 Sep 19 12:00:49.691119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 230/434] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:50.239364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:50.239964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:50.247165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:50.247654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:50.248119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:50.249550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:50.251392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:50.252658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:50.274323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:50.401568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:50.411189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:50.412780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:50.414065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-84ebf85b-0918-42ab-952a-102a3d5b64ca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.178917 Sep 19 12:00:50.414624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 205/435] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:50.484202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:50.484898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:50.492136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:50.492618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:50.493047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:50.493744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:50.494400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:50.494848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:50.662051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:50.670607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b05f9e23-e800-4788-9955-f56100cdf0e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1318 microversion: 2.1 time: 0.191873 Sep 19 12:00:50.671270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 231/436] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:50 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:51.441344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:51.443029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:51.450687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:51.451171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:51.451598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:51.452293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:51.452741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:51.453159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:51.613422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:51.622830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:51.624680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:51.625969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2ac727a-33fd-4ea9-961e-c725aa40b705 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.189179 Sep 19 12:00:51.626534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 206/437] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:51.695041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:51.695615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:51.703365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:51.704034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:51.704468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:51.705457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:51.705947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:51.706441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:51.841374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:51.850023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba78f62a-6c6b-4963-baa8-4252c73e32c4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1318 microversion: 2.1 time: 0.158780 Sep 19 12:00:51.850596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 232/438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:51 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:52.653025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:52.653706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:52.660737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:52.661220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:52.661651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:52.662385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:52.662837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:52.663262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:52.797078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:52.805750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:52.807714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:52.808875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d61bf454-b51b-40b0-bbc3-4bdd3adbd1e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.160356 Sep 19 12:00:52.809442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 207/439] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:52.873276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:52.873914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:52.881079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:52.881650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:52.882117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:52.883000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:52.883578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:52.884016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:53.020581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:53.024519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:53.033458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87e5dbdd-cceb-4793-b883-1a55cc013fb9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1318 microversion: 2.1 time: 0.161249 Sep 19 12:00:53.036717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 233/440] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:52 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:53.836357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:53.837024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:53.844387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:53.844968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:53.845296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:53.846022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:53.846473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:53.846885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:53.983789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:53.992668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:53.994199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:53.995448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d67cad44-3fa5-436c-ac77-0f65432a2d4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.163049 Sep 19 12:00:53.996176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 208/441] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:54.053621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:54.054212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:54.062039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:54.062532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:54.062965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:54.063669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:54.064114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:54.064534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:54.202852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:54.210520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40808135-6ee5-408b-9ecb-0f68c7aa0356 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1318 microversion: 2.1 time: 0.161246 Sep 19 12:00:54.211096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 234/442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:54 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:55.022238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:55.022828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:55.029690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:55.030190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:55.030623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:55.031311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:55.031755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:55.032170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:55.108930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-cb25c304-b298-4cde-90a1-38f0895d7b38 req-78d0f29b-125b-44a2-aa07-124c83aa5962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8311d2-58be-42df-b177-55a98bebcb2e", "name": "network-vif-plugged", "status": "completed", "tag": "77fc5477-7847-499d-a893-472333c63a06"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:55.120372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cb25c304-b298-4cde-90a1-38f0895d7b38 req-78d0f29b-125b-44a2-aa07-124c83aa5962 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:55.120984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cb25c304-b298-4cde-90a1-38f0895d7b38 req-78d0f29b-125b-44a2-aa07-124c83aa5962 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:55.121720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cb25c304-b298-4cde-90a1-38f0895d7b38 req-78d0f29b-125b-44a2-aa07-124c83aa5962 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:55.140499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-cb25c304-b298-4cde-90a1-38f0895d7b38 req-78d0f29b-125b-44a2-aa07-124c83aa5962 service nova] Creating event network-vif-plugged:77fc5477-7847-499d-a893-472333c63a06 for instance 6e8311d2-58be-42df-b177-55a98bebcb2e on hv-cinder-85829 Sep 19 12:00:55.149221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-cb25c304-b298-4cde-90a1-38f0895d7b38 req-78d0f29b-125b-44a2-aa07-124c83aa5962 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044852 Sep 19 12:00:55.150443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 235/443] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:00:55.178744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:55.187591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:55.188824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:55.190108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e88c8a65-b0a5-4b54-8639-b9cdf636aa16 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.171861 Sep 19 12:00:55.199149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 209/444] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:55.234892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:55.235652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:55.243050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:55.243568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:55.244002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:55.244726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:55.245175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:55.245601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:55.396795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:55.405462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0c7b524-b3e0-4fad-b427-db36a890150e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1318 microversion: 2.1 time: 0.175051 Sep 19 12:00:55.406098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 236/445] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:55 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:56.216732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:56.217531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:56.220056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=10 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:00:56.225356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:56.225910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:56.226348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:56.227044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:56.227499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:56.227923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:56.362258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:56.371405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:56.372829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:56.374012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3480aa4-2210-409a-a519-7a88411ddff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.161779 Sep 19 12:00:56.374557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 210/446] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:56.428136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:56.428741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:56.435262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:56.435748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:56.436183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:56.436890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:56.437456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:56.437811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:56.581403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:56.590671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d5d55e7-a9fe-435d-ba0e-1b314c3c0b87 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1318 microversion: 2.1 time: 0.166324 Sep 19 12:00:56.591294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 237/447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:56 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:57.400514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:57.401155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:57.407609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:57.408087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:57.408513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:57.409202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:57.409646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:57.410093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:57.543354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:57.552207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:57.553726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:57.554922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f97ddbf0-f2c0-4bf9-bbf2-b3f79ea3baca tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.158451 Sep 19 12:00:57.555478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 211/448] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:57.615076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:57.615648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:57.623760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:57.624244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:57.624703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:57.625408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:57.625912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:57.626336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:57.758758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:57.766436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48e624d7-f90c-48cd-922c-ea21d24badfc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1507 microversion: 2.1 time: 0.155309 Sep 19 12:00:57.767005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 238/449] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:00:57 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:00:57.790320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40065670-bf02-49b9-b40c-9ab869fa1c4a", "device": "/dev/sdb"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:57.794054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:57.799910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:57.800397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:57.800836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:57.801531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:57.802025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:57.802454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:58.058053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cbbd6759-a2d4-47a7-be2a-98bb89fe52dd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "POST /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271346 Sep 19 12:00:58.058674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 212/450] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:00:57 2022] POST /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:58.581842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:58.582452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:58.588440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:58.588920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:58.589599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:58.590328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:58.590786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:58.591208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:58.727510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:58.736607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:58.738248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:58.739427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-714940e0-4554-4a5e-a848-ad047789d151 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.161557 Sep 19 12:00:58.739962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 239/451] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:00:59.122391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-f2c1e98b-a225-4913-94c2-299a52e626c8 req-e1610d56-232b-4ac7-b96d-c97aa2d5ed2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "name": "network-vif-plugged", "status": "completed", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:00:59.136084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f2c1e98b-a225-4913-94c2-299a52e626c8 req-e1610d56-232b-4ac7-b96d-c97aa2d5ed2d service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:59.136574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f2c1e98b-a225-4913-94c2-299a52e626c8 req-e1610d56-232b-4ac7-b96d-c97aa2d5ed2d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:59.137005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f2c1e98b-a225-4913-94c2-299a52e626c8 req-e1610d56-232b-4ac7-b96d-c97aa2d5ed2d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:59.151881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-f2c1e98b-a225-4913-94c2-299a52e626c8 req-e1610d56-232b-4ac7-b96d-c97aa2d5ed2d service nova] Creating event network-vif-plugged:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 12:00:59.160879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-f2c1e98b-a225-4913-94c2-299a52e626c8 req-e1610d56-232b-4ac7-b96d-c97aa2d5ed2d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042381 Sep 19 12:00:59.161547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 213/452] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:00:59.765088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:00:59.765882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:00:59.773203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:59.773677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:59.774146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:59.774843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:00:59.775297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:00:59.775729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:00:59.905258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:59.913948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:59.915384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:00:59.916530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c55b117-37f4-4172-8f5b-21f1a0a23dbf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.155982 Sep 19 12:00:59.917080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 240/453] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:00:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:00.942404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:00.943101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:00.949679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:00.950191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:00.950628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:00.951314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:00.951765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:00.952215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:01.087259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:01.096697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:01.098167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:01.099331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7cfb5c6a-b7df-4c2d-9759-418d8e2080e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.161757 Sep 19 12:01:01.099893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 214/454] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:02.125392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:02.126047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:02.135776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:02.136348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:02.136879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:02.137663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:02.138215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:02.138715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:02.277971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:02.286624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:02.288076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:02.289217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e46bd6e-6332-4cf8-aa7d-eeb9396c0956 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1807 microversion: 2.20 time: 0.168604 Sep 19 12:01:02.289911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 241/455] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:01:03.314973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:03.315585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:03.322132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:03.322623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:03.323060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:03.323756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:03.324703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:03.325205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:03.459923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:03.468932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:03.470421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:03.471583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12fe9373-7fb7-4a2b-81b0-c5b904748507 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1794 microversion: 2.20 time: 0.160528 Sep 19 12:01:03.472184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 215/456] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1794 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:04.922040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-491323964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2116099399", "security_groups": [{"name": "tempest-secgroup-smoke-1664530382"}], "block_device_mapping_v2": [{"uuid": "1607f771-d912-4b2c-b8e4-67861d03db91", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "72c7c556-6bd7-4ac6-8409-0881ab894144"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:05.258026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] validate_networks() for [('72c7c556-6bd7-4ac6-8409-0881ab894144', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:01:05.632492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:01:05.632925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:01:05.633386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:01:05.633830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:01:05.634246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:01:05.643377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:05.643864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:05.644298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:05.645022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:05.645476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:05.645924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:05.666306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Getting quotas for project 2f7dd7174903460989484c1ab233208a. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:01:05.670450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Getting quotas for user fc84618366b045658728196980072790 and project 2f7dd7174903460989484c1ab233208a. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:01:05.736695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:01:05.738774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1607f771-d912-4b2c-b8e4-67861d03db91',volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:01:05.878202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90224c74-8301-41c6-a9b1-ff48a673ddeb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.959906 Sep 19 12:01:05.878955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 242/457] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:01:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:01:05.890566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-15444740-e12e-4cb5-8396-99e98f44e3b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:05.891162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-15444740-e12e-4cb5-8396-99e98f44e3b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:05.893745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:05.947198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-15444740-e12e-4cb5-8396-99e98f44e3b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:05.954618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-15444740-e12e-4cb5-8396-99e98f44e3b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1094 microversion: 2.1 time: 0.068549 Sep 19 12:01:05.955184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 216/458] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:06.977956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:06.978560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:06.984772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:06.985247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:06.985739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:06.986392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:06.986840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:06.987255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:07.050311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:07.057955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-831f5b14-0f46-4a19-8672-213a71e26d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1144 microversion: 2.1 time: 0.084615 Sep 19 12:01:07.058571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 243/459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:08.080633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:08.081232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:08.089113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:08.090400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:08.090857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:08.091548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:08.092002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:08.092424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:08.156581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:08.164355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-582ddb55-18d5-49d4-bc6a-083620ee3428 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1136 microversion: 2.1 time: 0.087671 Sep 19 12:01:08.164926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 217/460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1136 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:09.177868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:09.178398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:09.180797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:09.186151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.186653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.187092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.187789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.187893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:09.188320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.188422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:09.188654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.195708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.196191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.196701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.197311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.197775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.198206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.268791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:09.277042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e2d8051b-1dda-4902-bcf0-0f84959970d8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1192 microversion: 2.1 time: 0.092746 Sep 19 12:01:09.290120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 218/461] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1192 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:09.317378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lazy-loading 'services' on Instance uuid 9ad06da9-6475-4fc6-a5f2-a98250348a27 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:01:09.431425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5dbcc513-2c8a-4983-9196-17c52c5f20e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments/cb8ac1c6-a244-4c13-b586-38ab3da884d3" status: 202 len: 0 microversion: 2.1 time: 0.257379 Sep 19 12:01:09.432016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 244/462] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:01:09 2022] DELETE /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments/cb8ac1c6-a244-4c13-b586-38ab3da884d3 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:01:09.755898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4602f212-2cc8-4051-b479-1a468e14ba50"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:09.758461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:09.765028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.765518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.765986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.766702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.767163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.767829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:10.233389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae2e4aef-ff46-4bb8-b7df-30e4677b8f26 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "POST /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481354 Sep 19 12:01:10.234281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 219/463] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:01:09 2022] POST /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:10.304030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:10.305336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:10.312776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:10.313361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:10.313924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:10.314906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:10.315456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:10.317541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:10.386321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:10.395341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f46072e4-8aa2-4662-87fe-5a981b69985a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1210 microversion: 2.1 time: 0.097220 Sep 19 12:01:10.396007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 245/464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:11.390258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-45c9bd11-7680-4225-8059-539d6d4278fb req-2271d3e2-5b2f-456f-aca1-b1c6252d955a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4153682a-ad93-4f2a-ae86-2e343258d773", "tag": "ef44d266-e681-4d11-a178-ca3523c5f42c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:11.396142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-45c9bd11-7680-4225-8059-539d6d4278fb req-2271d3e2-5b2f-456f-aca1-b1c6252d955a service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:11.397176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-45c9bd11-7680-4225-8059-539d6d4278fb req-2271d3e2-5b2f-456f-aca1-b1c6252d955a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:11.397627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-45c9bd11-7680-4225-8059-539d6d4278fb req-2271d3e2-5b2f-456f-aca1-b1c6252d955a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:11.409958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-45c9bd11-7680-4225-8059-539d6d4278fb req-2271d3e2-5b2f-456f-aca1-b1c6252d955a service nova] Creating event network-changed:ef44d266-e681-4d11-a178-ca3523c5f42c for instance 4153682a-ad93-4f2a-ae86-2e343258d773 on hv-cinder-85829 Sep 19 12:01:11.419311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:11.419905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:11.424406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-45c9bd11-7680-4225-8059-539d6d4278fb req-2271d3e2-5b2f-456f-aca1-b1c6252d955a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054946 Sep 19 12:01:11.426802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:11.427568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:11.427696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 220/465] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:11.428814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:11.429729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:11.430229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:11.430655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:11.567542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:11.577134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d4ad1ec-2125-4416-ba42-c5294cce297c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162122 Sep 19 12:01:11.578184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 246/466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:12.601446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:12.602204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:12.608503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:12.608990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:12.609425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:12.610160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:12.610613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:12.611035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:12.745174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:12.749229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:12.754311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-566df3ab-fd0c-4615-9593-991b715068ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157511 Sep 19 12:01:12.754881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 221/467] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:13.779159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:13.779771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:13.786160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.786638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.787066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.787749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.788200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.788622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.919715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:13.927337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b05dc27c-92bd-4eae-9be9-f8a216ce525b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152138 Sep 19 12:01:13.927904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 247/468] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:14.951384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:14.951993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:14.959934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:14.960413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:14.960839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:14.961538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:14.962014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:14.962435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:15.096193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:15.103830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-061c64fa-7bb1-409a-91b8-3b8ded02367c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158016 Sep 19 12:01:15.104387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 222/469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:16.127389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:16.127953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:16.130412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:16.131246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:16.138166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:16.138658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:16.139090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:16.139792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:16.140244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:16.140669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:16.272052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:16.279834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a80497b5-cdb2-406c-a2b1-2ed4b9d1711f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156318 Sep 19 12:01:16.280727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 248/470] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:17.303231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:17.303830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:17.306094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:17.311692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:17.312172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:17.312603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:17.313282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:17.313727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:17.314497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:17.458158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:17.466572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50ffad36-29ad-4269-8ab9-2dbded6b4b9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.167161 Sep 19 12:01:17.467130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 223/471] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:18.489270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:18.489812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:18.496619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:18.497088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:18.497515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:18.498227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:18.498673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:18.499088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:18.631780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:18.640013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a47ae4a5-1a32-416c-9fee-ff87542ba699 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154701 Sep 19 12:01:18.640570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 249/472] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:19.662492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:19.663085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:19.669632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:19.670149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:19.670590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:19.671281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:19.671734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:19.672157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:19.801121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:19.809946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94144f9f-1154-4c50-b71f-328b8a663215 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151225 Sep 19 12:01:19.810525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 224/473] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:20.832168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:20.832822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:20.839864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:20.840399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:20.840957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:20.841670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:20.842207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:20.842687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:20.983510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:20.991118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5915fda6-a20c-4408-afce-7f71dc918e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162834 Sep 19 12:01:20.991670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 250/474] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:22.014601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:22.015240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:22.021964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:22.022508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:22.022947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:22.023645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:22.024102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:22.024524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:22.155401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:22.163113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dc812e3a-a77f-4b14-b93c-598c9f4ea004 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152460 Sep 19 12:01:22.163884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 225/475] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:23.186315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:23.187010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:23.193510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:23.193948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:23.194386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:23.195083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:23.195535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:23.195957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:23.200160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:23.344873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:23.353103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93ab8442-a69a-441e-bb5a-200a098e8c8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.170650 Sep 19 12:01:23.353923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 251/476] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:24.376252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:24.376882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:24.383423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:24.383900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:24.384331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:24.385014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:24.385462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:24.386571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:24.519058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:24.526695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d994c08-1ab2-4199-bb53-33d94c0d48da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154365 Sep 19 12:01:24.527262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 226/477] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:25.550153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:25.550760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:25.557280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:25.557793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:25.558239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:25.558932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:25.559386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:25.559808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:25.688285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:25.695998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b60fcc0-bc5f-44b6-88bc-306d5f1ea211 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.149678 Sep 19 12:01:25.696565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 252/478] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:26.719331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:26.719922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:26.726167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:26.726643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:26.727068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:26.727747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:26.728192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:26.728609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:26.862844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:26.870851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-522c1f43-6796-4f9e-bdc0-651c8bf546ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155435 Sep 19 12:01:26.871417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 227/479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:27.895121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:27.895732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:27.902515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:27.903164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:27.903658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:27.904353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:27.904834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:27.905315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:28.035059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:28.042735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ef06428-cf73-4bd9-bbd2-5f6f1b553e45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151569 Sep 19 12:01:28.043297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 253/480] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:29.066335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:29.066938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:29.073599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:29.074121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:29.074547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:29.075863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:29.076311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:29.076734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:29.212783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:29.220653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30d6c8a9-c886-48e0-a504-32130421e465 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158206 Sep 19 12:01:29.221213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 228/481] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:30.243754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:30.244350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:30.250721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:30.251204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:30.251636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:30.252319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:30.252767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:30.253187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:30.382917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:30.392484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7dcbf0e-1840-4d0b-8616-522491411a7b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152331 Sep 19 12:01:30.393163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 254/482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:31.414895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:31.415503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:31.422029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:31.422513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:31.422955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:31.423650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:31.424106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:31.424531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:31.571592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:31.579289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e612aa0-a5e6-4208-bae7-dd5e39ccf626 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.168267 Sep 19 12:01:31.579861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 229/483] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:32.602173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:32.602778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:32.611513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:32.611993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:32.612424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:32.613105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:32.613550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:32.614000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:32.746984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:32.754698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73e81125-e1bb-43db-9c1f-5a4df101d6b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156276 Sep 19 12:01:32.755290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 255/484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:33.777825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:33.778449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:33.784895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:33.785371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:33.785821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:33.786526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:33.786972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:33.787382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:33.938014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:33.945716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6fabdee6-8514-4dd4-93b2-ba91f30f6c01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.171762 Sep 19 12:01:33.946318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 230/485] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:34.968324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:34.968933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:34.975359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:34.975846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:34.976282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:34.976977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:34.977463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:34.977927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:35.114663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:35.122946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e2c4efc-8080-4120-a1dd-3f9132ab7717 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158249 Sep 19 12:01:35.123514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 256/486] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:34 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:36.145544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:36.146183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:36.148502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=32 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:36.154366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:36.154869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:36.155310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:36.156005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:36.156463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:36.156888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:36.290987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:36.298747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34f58b21-e9dc-44ba-9393-bd7180851e3d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157032 Sep 19 12:01:36.299331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 231/487] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:37.322378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:37.322993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:37.329127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:37.329610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:37.330089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:37.330789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:37.331240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:37.331660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:37.466366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:37.474994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-844df0ad-203b-4ec6-a40c-919530008c0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156630 Sep 19 12:01:37.475559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 257/488] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:38.497399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:38.497966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:38.504924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:38.505409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:38.505865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:38.506554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:38.507001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:38.507420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:38.637943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:38.645622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-848bc022-877b-4804-b261-6f98488c5a21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152159 Sep 19 12:01:38.646220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 232/489] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:39.668591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:39.669193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:39.672253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:39.677496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:39.678002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:39.678430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:39.679110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:39.679553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:39.679968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:39.814681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:39.822243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72fa446f-a204-4ec2-99a4-e3d32c48ed07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157510 Sep 19 12:01:39.822792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 258/490] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:39 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:40.845653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:40.846295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:40.852914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:40.853407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:40.853878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:40.854585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:40.855043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:40.855469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:40.987170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:40.994869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f635094-4f7e-4b38-8fe7-b15317e437ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153081 Sep 19 12:01:40.995451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 233/491] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:41.938262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:41.938840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:41.945035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:41.945515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:41.945977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:41.946658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:41.947104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:41.947513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:41.977245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0461cbc1-5646-4b97-a9a7-8a2c2cd29be7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments/2d741d5f-580c-4790-91e4-6c782fc6ee46" status: 200 len: 194 microversion: 2.20 time: 0.042978 Sep 19 12:01:41.977835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 259/492] 10.222.0.88 () {60 vars in 1454 bytes} [Mon Sep 19 12:01:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments/2d741d5f-580c-4790-91e4-6c782fc6ee46 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:42.019509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:42.020118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:42.026996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.027564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.028062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.028825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.029363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.029895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.045192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:42.045675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:42.051755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.053075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.054004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.054642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.055284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.150926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lazy-loading 'services' on Instance uuid a51246d5-fe0a-4b24-a1d4-a580a28f16b2 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:01:42.169812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:42.177814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-abfffac6-e665-4ad5-b279-e1d50d6e7995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162671 Sep 19 12:01:42.178586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 234/493] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:42.223854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b68b6e27-a48e-41f1-9dd6-d53fb0594599 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments/2d741d5f-580c-4790-91e4-6c782fc6ee46" status: 202 len: 0 microversion: 2.20 time: 0.182405 Sep 19 12:01:42.224424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 260/494] 10.222.0.88 () {60 vars in 1457 bytes} [Mon Sep 19 12:01:42 2022] DELETE /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments/2d741d5f-580c-4790-91e4-6c782fc6ee46 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:01:42.233868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:42.236089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:42.242067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.242609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.242991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.243689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.244614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.245037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.277450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17f70a24-06fa-4822-9fed-b0164712271a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048396 Sep 19 12:01:42.278045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 235/495] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:01:43.201445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:43.202178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:43.208507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.208935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.209375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.210101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.210564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.210988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.290520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:43.292699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:43.299895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.300381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.300831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.301530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.302019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.302440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.332378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36170a4b-0c0e-46dc-9821-4cba55ba2c4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045869 Sep 19 12:01:43.333114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 236/496] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:01:43.347725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:43.361074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e8e71e1-2e21-48de-a2d7-b3d74096e55d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.164199 Sep 19 12:01:43.361653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 261/497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:44.345570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:44.347828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:44.360851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.361338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.361783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:44.362502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.362950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.363395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:44.383843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:44.384449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:44.390859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.391339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.391767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:44.392453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.392893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.393307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:44.395771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dcc453de-e84d-4841-8792-4f3a825563bc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054211 Sep 19 12:01:44.396346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 237/498] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:44.535617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:44.543324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26eb3cfb-be00-4e67-9b8d-9fe9318cb6c8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.163378 Sep 19 12:01:44.543878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 262/499] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:45.409205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:45.411380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:45.418259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:45.418748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:45.419186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:45.419884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:45.420338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:45.420766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:45.424088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:45.451823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71a589b2-5798-4884-9635-65cc8c14eddc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047305 Sep 19 12:01:45.452387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 238/500] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:45.567378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:45.567990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:45.577675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:45.578352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:45.578775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:45.579816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:45.580347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:45.580942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:45.715634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:45.723941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4ace526-59da-4b44-973f-cff63633551f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160886 Sep 19 12:01:45.724505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 263/501] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:46.465167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:46.467311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:46.474308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.474782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.475219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.475913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.476366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.476790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.506995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4d50f001-04c9-4a79-8d55-991913dc6b22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046264 Sep 19 12:01:46.507544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 239/502] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:46.746292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:46.746844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:46.753743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.754245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.754673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.755382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.755828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.756247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.886119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:46.893816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a8dd531-4d61-4867-9311-82dbacb3aa5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151684 Sep 19 12:01:46.894386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 264/503] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:47.520465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:47.522643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:47.529055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:47.529537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:47.530007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:47.530708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:47.531161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:47.531587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:47.561143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7fdf2b77-b613-4645-984d-b6bc63174634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Sep 19 12:01:47.561696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 240/504] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:47.917158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:47.917723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:47.924584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:47.925087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:47.925486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:47.926201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:47.926647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:47.927065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:48.057304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:48.065511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78a4e696-70c3-440c-a32c-530956a2b499 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152317 Sep 19 12:01:48.066095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 265/505] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:48.574412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:48.576554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:48.583191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:48.583676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:48.584115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:48.584809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:48.585269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:48.585696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:48.616236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d71d16f6-d18f-49b3-b16c-3721ec327d39 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045822 Sep 19 12:01:48.616802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 241/506] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:49.088266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:49.088915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:49.095482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:49.095952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:49.096375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:49.097052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:49.097497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:49.097935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:49.230024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:49.237662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fac901e6-d952-4aa2-8053-5a4e028ff260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153224 Sep 19 12:01:49.238253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 266/507] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:49.629591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:49.631756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:49.638131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:49.638617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:49.639050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:49.639740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:49.640236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:49.640661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:49.670404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c28dd041-3602-42d0-bcb4-ffc48f312d22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045632 Sep 19 12:01:49.670960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 242/508] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:50.260715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:50.261325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:50.267888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:50.268371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:50.268807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:50.269505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:50.269990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:50.270417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:50.274422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:50.401515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:50.409116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b71a69d-b233-4219-88cf-f00452d8eb61 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152307 Sep 19 12:01:50.409675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 267/509] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:50.683898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:50.686009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:50.692409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:50.692888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:50.693317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:50.694028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:50.694475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:50.694893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:50.724213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d43cc911-75a6-4865-9e28-ac4bb0c64a6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044426 Sep 19 12:01:50.724759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 243/510] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:51.432209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:51.432822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:51.439260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.439746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.440182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.440876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.441330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.441804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.579977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:51.587782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b4df48c-b783-4b35-956f-c3d0ca31a086 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159432 Sep 19 12:01:51.588339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 268/511] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:51.736902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:51.738981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:51.745533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.746040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.746478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.747172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.747648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.748070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.777412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4672d6f9-b129-4042-b22d-905f4d1578d5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044559 Sep 19 12:01:51.777987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 244/512] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:52.612104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:52.612688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:52.619345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:52.619832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:52.620262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:52.620992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:52.621503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:52.621822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:52.753875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:52.761613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a14a774-4381-4717-8835-3fd116671890 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153878 Sep 19 12:01:52.762291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 269/513] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:52.790519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:52.792660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:52.799729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:52.800212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:52.800648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:52.801339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:52.801817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:52.802240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:52.831395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96f5affa-e436-47ab-9e54-264e7dfc60cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044760 Sep 19 12:01:52.831957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 245/514] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:53.784098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:53.784988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:53.791972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:53.792464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:53.792901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:53.793604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:53.794094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:53.794514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:53.843916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:53.846162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:53.852720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:53.853205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:53.854520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:53.854520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:53.854810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:53.855232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:53.886778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6bb0827-47a8-481f-a553-9869c94a5d08 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047156 Sep 19 12:01:53.887562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 246/515] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:01:53.932652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:53.943499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58580362-a758-404f-b473-124f4f22e885 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162942 Sep 19 12:01:53.944503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 270/516] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:54.900220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:54.902368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:54.908964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:54.909446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:54.909912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:54.910610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:54.911062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:54.911487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:54.944544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfb0e5d1-311a-4bd6-b188-94f18d54275d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048224 Sep 19 12:01:54.945130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 247/517] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:54.966920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:54.967534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:54.974425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:54.974875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:54.975309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:54.976011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:54.976465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:54.976880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.116976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:55.124715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd3f7dcc-3c92-4f5a-b934-90a1d002e0f6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161930 Sep 19 12:01:55.125282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 271/518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:55.958671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:55.960821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:55.967495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:55.967983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:55.968456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.969155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:55.969611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:55.970062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.998618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e718e93b-1e93-4d5b-bf18-1ddf6fb930de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044464 Sep 19 12:01:55.999173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 248/519] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:56.147360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:56.147940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:56.154904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:56.155650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:56.156286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:56.157174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:56.158044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:56.158606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:56.287519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:56.295271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b73215e-84ab-4681-8911-3c5c6f03f720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151874 Sep 19 12:01:56.295837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 272/520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:57.012105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:57.014562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:57.022167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:57.022655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:57.023091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:57.023790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:57.024243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:57.024663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:57.056261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-26502b95-1aee-40ec-a758-aa6c395f2cd6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048094 Sep 19 12:01:57.056833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 249/521] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:57.318731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:57.319315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:57.325801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:57.326285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:57.326716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:57.327464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:57.328451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:57.328876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:57.463725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:57.472031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15f7c383-2387-4c24-9889-3f0df73207d5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156845 Sep 19 12:01:57.472594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 273/522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:58.069176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:58.071444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:58.078311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:58.078897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:58.079339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:58.080046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:58.080503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:58.080931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:58.110947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-26929d43-51f2-4e77-874a-d82ce09e939f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046013 Sep 19 12:01:58.111496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 250/523] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:58.494926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:58.495469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:58.501859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:58.502344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:58.502784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:58.503479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:58.503932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:58.504364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:58.633187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:58.641412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ccea190-8ad0-4996-bfb2-4c052a89e347 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150425 Sep 19 12:01:58.642006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 274/524] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:59.123552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:59.125679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:59.132292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:59.132780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:59.133217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:59.133955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:59.134405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:59.135091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:59.166778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ba6d848c-2ffa-4df2-b376-cd7c4ce53a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047170 Sep 19 12:01:59.167337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 251/525] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:01:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:59.664583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:59.665113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:59.671597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:59.672086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:59.672549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:59.673237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:59.673695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:59.674153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:59.805549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:59.813658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8d83170-5d87-48c2-97e8-9385a2abe9aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153160 Sep 19 12:01:59.814254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 275/526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:00.178773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:00.180894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:00.187407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:00.187880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:00.188316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:00.189000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:00.189438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:00.189887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:00.219637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-978e858b-f139-43f3-81df-a36bc5009d31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044813 Sep 19 12:02:00.220187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 252/527] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:00.836465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:00.837067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:00.844246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:00.844728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:00.845159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:00.845880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:00.846333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:00.846751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:00.975070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:00.982838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a471960-0484-4b01-bdfd-6c0b60d70ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150168 Sep 19 12:02:00.983406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 276/528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:01.232560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:01.235353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:01.241701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:01.242281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:01.242720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:01.243411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:01.243867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:01.244320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:01.273699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3b06bbe-6405-4a48-8b12-63844a967000 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045127 Sep 19 12:02:01.274368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 253/529] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:02.006532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:02.007133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:02.013724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:02.014245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:02.014681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:02.016021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:02.016477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:02.016902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:02.144809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:02.152991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59b432ac-01fa-4e66-b5cb-ebc91ea022f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150264 Sep 19 12:02:02.153553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 277/530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:02.285949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:02.288098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:02.294546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:02.295019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:02.295449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:02.296132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:02.297070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:02.297512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:02.322838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:02.329049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e15ed6d1-d60f-44c1-8399-41eddbce21fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047016 Sep 19 12:02:02.329619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 254/531] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:03.176567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:03.177178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:03.183552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:03.184040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:03.184481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:03.185173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:03.185632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:03.186090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:03.322298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:03.332020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d7132cf-cda7-47fd-8e4e-f39365cbb5b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159270 Sep 19 12:02:03.332587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 278/532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:03.341599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:03.344326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:03.351083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:03.351570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:03.352035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:03.352747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:03.353197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:03.353617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:03.388923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab0a36d6-c179-4d42-a903-de6cb14491e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051477 Sep 19 12:02:03.389924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 255/533] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:04.355654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:04.356238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:04.363131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:04.363612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:04.364037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:04.364724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:04.365165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:04.365579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:04.403146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:04.405198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:04.411625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:04.412107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:04.412537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:04.413233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:04.413680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:04.414127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:04.444987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b653d1b-c71e-42d0-b97b-3cc4343bc7a0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045794 Sep 19 12:02:04.445567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 256/534] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:04.496083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:04.505276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3eb4fd46-7220-45a9-8360-21b86b1164cc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153403 Sep 19 12:02:04.505878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 279/535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:05.457439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:05.459649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:05.466454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:05.466939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:05.467380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:05.468078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:05.468731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:05.469158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:05.499383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ecc6a0d-9411-4858-8cc1-a6bf6b559ef5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045878 Sep 19 12:02:05.499934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 257/536] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:05.528048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:05.528655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:05.535779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:05.536267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:05.536710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:05.537401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:05.537886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:05.538310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:05.674763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:05.682767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-694f6aa0-ba8a-4b05-8073-68aaea3b8bfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158573 Sep 19 12:02:05.683335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 280/537] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:06.511827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:06.513991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:06.516280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=54 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:06.522131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:06.522618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:06.523055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:06.523754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:06.524207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:06.524631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:06.553556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63cb4d23-0db6-4da6-992e-64d3cc4c289e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045702 Sep 19 12:02:06.554147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 258/538] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:06.706035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:06.706641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:06.712528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:06.713010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:06.713477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:06.714174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:06.714899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:06.715318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:06.850247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:06.857845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f391f6e8-453a-44af-965d-cf2b13c17a35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156019 Sep 19 12:02:06.858415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 281/539] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:07.566272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:07.568412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:07.574796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:07.575301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:07.575738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:07.576423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:07.576868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:07.577281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:07.607394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d30c8a9-5a54-4576-a17d-6d0963f4053a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045141 Sep 19 12:02:07.607935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 259/540] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:07.881082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:07.881673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:07.888005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:07.888476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:07.888900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:07.889579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:07.890055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:07.890475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:08.023646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:08.032516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2616fc89-5663-4e36-b489-0d6c46eeb188 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154670 Sep 19 12:02:08.033091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 282/541] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:08.619787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:08.621994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:08.628913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:08.629404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:08.629871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:08.630570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:08.631027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:08.631454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:08.661435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd09d784-158d-409b-bf22-c34dcbd20933 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045585 Sep 19 12:02:08.662081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 260/542] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:09.058521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:09.059128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:09.065604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:09.066059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:09.066498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:09.067191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:09.067647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:09.068067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:09.202354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:09.206389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:09.211516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af7c1ff9-a70b-4207-b796-f4a4a6ed2129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156801 Sep 19 12:02:09.212092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 283/543] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:09.674487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:09.676555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:09.683033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:09.683518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:09.683955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:09.684648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:09.685101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:09.685525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:09.716718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b86cdb7-4110-448a-8d5d-bec36c62e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046780 Sep 19 12:02:09.717300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 261/544] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:10.235845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:10.236382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:10.238831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:10.243971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:10.244451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:10.244887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:10.245576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:10.246049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:10.246470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:10.374670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:10.382431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-023c3c72-2011-4e25-b095-cf0fc25f972a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151143 Sep 19 12:02:10.383001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 284/545] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:10.729732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:10.731930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:10.738508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:10.738978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:10.739402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:10.740085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:10.740527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:10.740940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:10.773731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d7933ec-08ef-472d-a234-f14fb140a06b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047549 Sep 19 12:02:10.774696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 262/546] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:11.405321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:11.405952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:11.412935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:11.413412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:11.413877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:11.414561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:11.415005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:11.415421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:11.555381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:11.563840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b90be613-ccdb-4ac3-aecf-72b907a2337d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161710 Sep 19 12:02:11.564505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 285/547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:11.786971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:11.789105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:11.795487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:11.795970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:11.796405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:11.797092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:11.797542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:11.797992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:11.826751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-699da225-e4f6-4fb2-b148-86d83c8ba478 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043754 Sep 19 12:02:11.827299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 263/548] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:12.587065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:12.587675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:12.594219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:12.595226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:12.595646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:12.596352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:12.596803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:12.597213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:12.726451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:12.734153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13d464d5-986f-494e-a53d-3e880bcdf769 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150932 Sep 19 12:02:12.734717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 286/549] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:12.840706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:12.842970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:12.850339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:12.850827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:12.851264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:12.851966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:12.852418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:12.852843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:12.884219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b287dac-d61d-43bc-9c1a-f3574cfa344e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047599 Sep 19 12:02:12.884875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 264/550] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:13.756981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:13.757594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:13.763959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:13.764444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:13.764881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:13.765575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:13.766058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:13.767076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:13.897609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:13.899970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:13.903830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:13.906363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:13.906891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:13.907335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:13.908052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:13.908495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:13.908929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:13.911917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ff0db2f-13d3-43f0-a67f-d6bf6fd23ede tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158814 Sep 19 12:02:13.912825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 287/551] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:13.939254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a953ceb5-ca5d-47f8-ae19-e27712f4abb2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045606 Sep 19 12:02:13.939810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 265/552] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:14.934697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:14.935353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:14.941917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:14.942414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:14.942847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:14.943540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:14.943995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:14.944419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:14.951849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:14.954218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:14.960576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:14.961060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:14.961494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:14.962233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:14.962711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:14.963133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:14.994612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-77759ad5-fc5a-49d2-bb8a-eb9c1d1b21c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046717 Sep 19 12:02:14.995385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 266/553] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:15.077569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:15.085286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64e8a4ef-b6f7-45d8-9883-917435d8dac1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154518 Sep 19 12:02:15.085879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 288/554] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:16.007834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:16.010169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:16.017134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:16.017605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:16.018070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:16.018759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:16.019204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:16.019617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:16.048570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2530694-9b82-4d8b-9016-c5c83d5b4e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044891 Sep 19 12:02:16.049121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 267/555] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:16.108470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:16.109069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:16.115901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:16.116374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:16.116800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:16.117478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:16.117956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:16.118374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:16.247341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:16.255486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49eab33e-8642-4f26-90cb-9f2deacf10a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150755 Sep 19 12:02:16.256018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 289/556] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:17.060969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:17.063148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:17.069538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:17.070052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:17.070499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:17.071186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:17.071641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:17.072061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:17.101932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e8dabc6-ff58-42a7-af79-a1d76e614c47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045066 Sep 19 12:02:17.102486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 268/557] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:17.277394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:17.278019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:17.285272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:17.285784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:17.286219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:17.286920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:17.287360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:17.287777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:17.423664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:17.431487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ba4bcec-93f5-47f8-b0ea-ab696c8fc850 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157995 Sep 19 12:02:17.432059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 290/558] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:18.115420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:18.117602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:18.123994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:18.124479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:18.124918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:18.126276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:18.126737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:18.127167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:18.156815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99a2b7f2-749b-4525-bd60-9b0ae7d6288b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045208 Sep 19 12:02:18.157382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 269/559] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:18.454184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:18.454858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:18.461295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:18.461792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:18.462221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:18.462913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:18.463357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:18.463772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:18.603466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:18.611691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50577ce0-8580-449a-86f8-492b240c172a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161258 Sep 19 12:02:18.612252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 291/560] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:19.169432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:19.171584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:19.178583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:19.179065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:19.179500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:19.180188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:19.180636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:19.181055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:19.210288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cccd8c9a-f774-4a63-ad97-cb3814f3c35e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044810 Sep 19 12:02:19.210854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 270/561] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:19.634287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:19.634883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:19.641753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:19.642259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:19.642684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:19.643360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:19.643800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:19.644211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:19.776287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:19.784513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5591666-a519-43c2-a203-ed150473465b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154107 Sep 19 12:02:19.785078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 292/562] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:20.223150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:20.225267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:20.231602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:20.232082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:20.232523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:20.233212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:20.233668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:20.234115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:20.248074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:20.264854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3ae5171-f391-43a1-af6e-2bc29d00fd14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045661 Sep 19 12:02:20.265408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 271/563] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:20.807161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:20.807768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:20.814326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:20.814812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:20.815242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:20.815928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:20.816379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:20.816796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:20.945866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:20.954189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ad312b1-11b8-469f-93f8-35215521395a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150356 Sep 19 12:02:20.955170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 293/564] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:21.277561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:21.279908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:21.287000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:21.287481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:21.287920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:21.288609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:21.289056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:21.289474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:21.319783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3597d9f3-3d68-496f-8ecb-c92ff5a7d5f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046206 Sep 19 12:02:21.320351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 272/565] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:21.980443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:21.980987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:21.988053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:21.988542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:21.988964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:21.989657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:21.990131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:21.990552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:22.127262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:22.135973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6320ed0-e5bd-4eaa-ae94-b0ad28e956d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159327 Sep 19 12:02:22.136588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 294/566] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:22.332432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:22.334603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:22.341413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:22.341953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:22.342393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:22.343093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:22.343569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:22.344491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:22.375753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5cff40e5-047e-4470-ae97-6d31e622aec3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047290 Sep 19 12:02:22.376324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 273/567] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:23.160197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:23.160813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:23.168211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:23.169085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:23.169572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:23.170326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:23.170781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:23.171207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:23.308125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:23.316058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8d38469-b050-4e7e-91f2-3ce0f26baab6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160502 Sep 19 12:02:23.316623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 295/568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:23.387976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:23.390162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:23.397299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:23.397808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:23.398240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:23.398927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:23.399407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:23.399797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:23.428943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dfc629b4-6632-4db4-9f69-fa041185f6c4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045008 Sep 19 12:02:23.429497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 274/569] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:24.340067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:24.340669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:24.347051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.347528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.347954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.348663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.349107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.349521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.442105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:24.444239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:24.450659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.451147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.451582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.452279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.452731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.453152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.483342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ed9e0ab6-0f1e-463b-97d7-f312266dcceb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045635 Sep 19 12:02:24.483911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 275/570] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:24.484579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:24.492610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54f47643-ce95-470d-82d9-57524bc274d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156644 Sep 19 12:02:24.493181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 296/571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:25.495943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:25.498196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:25.504747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:25.505231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:25.505669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:25.506392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:25.506848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:25.507271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:25.516398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:25.517005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:25.523412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:25.523900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:25.524359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:25.525043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:25.525493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:25.525969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:25.538769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cfb2c4e1-9996-4616-974a-4d796e21c0c9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046798 Sep 19 12:02:25.539354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 276/572] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:25.755921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:25.764397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1da7779-00e7-4a92-90ab-3d7a7e090e12 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.252512 Sep 19 12:02:25.764970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 297/573] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:26.551810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:26.554016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:26.560497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:26.560988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:26.561430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:26.562166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:26.562667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:26.563135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:26.595249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c5f54cfb-65f8-4fd8-8919-95431aafdd5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048320 Sep 19 12:02:26.595820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 277/574] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:26.791729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:26.792328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:26.799279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:26.799757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:26.800312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:26.801082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:26.801530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:26.801996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:26.941101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:26.948888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e524697-c61f-4ead-aa0e-24ec1c5f43de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160987 Sep 19 12:02:26.949486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 298/575] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:27.607076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:27.609268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:27.615774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:27.616258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:27.616694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:27.617388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:27.617873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:27.618302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:27.649494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d5eb7c3-6303-4725-a367-0890170cc056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046326 Sep 19 12:02:27.650105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 278/576] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:27.972636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:27.973235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:27.979539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:27.980014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:27.980441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:27.981120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:27.981570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:27.982006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:28.115265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:28.122802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a883e4e-0487-49e0-b30c-3ea48a6158e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154675 Sep 19 12:02:28.123355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 299/577] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:28.662339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:28.664465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:28.670521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:28.671006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:28.671445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:28.672694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:28.673156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:28.673641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:28.703894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0eb29db3-7908-4d7c-bf0e-464955fc9322 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045671 Sep 19 12:02:28.704454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 279/578] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:29.145470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:29.146100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:29.152439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:29.152917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:29.153346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:29.154063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:29.154509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:29.154918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:29.173541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:29.286061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:29.293925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-513e704d-7658-4dc2-9cf2-0874b629012d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152228 Sep 19 12:02:29.294504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 300/579] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:29.716915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:29.719191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:29.725844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:29.726387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:29.726866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:29.727584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:29.728043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:29.728471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:29.759143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd8fa90d-e0d1-47e4-9449-31c9eb3a357b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046456 Sep 19 12:02:29.759710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 280/580] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:30.316469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:30.317064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:30.323471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:30.323946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:30.324371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:30.325053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:30.325579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:30.325948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:30.459626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:30.467586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f63c120a-84af-411d-a2a9-0fb568d68c2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154957 Sep 19 12:02:30.468152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 301/581] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:30.771877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:30.774031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:30.780696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:30.781843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:30.782384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:30.783089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:30.783543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:30.783966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:30.812883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f5d640b-a7b8-4a85-b5a8-588a0dc9174d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044961 Sep 19 12:02:30.813441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 281/582] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:31.491340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:31.491946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:31.498446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.498922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.499354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.500711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.501163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.501584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.634638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:31.642792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00c07d9b-0136-4dcd-8d66-d4420478fa4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155337 Sep 19 12:02:31.643362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 302/583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:31.824952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:31.827130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:31.833978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.834462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.834897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.835589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.836040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.836461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.869320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6136330f-4d25-4fb5-986d-821f9d2b2ef9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048422 Sep 19 12:02:31.870068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 282/584] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:32.665880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:32.666552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:32.673152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:32.673640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:32.674161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:32.674847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:32.675297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:32.675718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:32.804376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:32.811931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7337540f-369a-4f51-a82e-45699a497cc6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.149888 Sep 19 12:02:32.813007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 303/585] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:32.882166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:32.884305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:32.891343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:32.891825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:32.892262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:32.892946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:32.893394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:32.893850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:32.923064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ce75128b-0384-48ff-b562-914c4ca28954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044811 Sep 19 12:02:32.923541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 283/586] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:33.835245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:33.835865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:33.842925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.843289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.843754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.844603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.845054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.845516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.935660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:33.939276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:33.945944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.946854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.947511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.948527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.949202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.950061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.983659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af478450-a543-4b99-8dff-8be99b13b50d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051885 Sep 19 12:02:33.985093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 284/587] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:34.004116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:34.012352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8ad1aec-2326-4481-bee1-290247b3a9b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.180978 Sep 19 12:02:34.013669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 304/588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:34.998714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:35.000843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:35.007369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:35.007858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:35.008292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:35.008990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:35.009436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:35.009976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:35.036119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:35.036753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:35.040279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12ab9c3a-b9aa-4844-83d0-01fd9d5e7cc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045489 Sep 19 12:02:35.040837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 285/589] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:35.043249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:35.043793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:35.044231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:35.044927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:35.045377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:35.045818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:35.180518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:35.188711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-709e8f75-9a6b-41de-80a1-3009a6b56a9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156277 Sep 19 12:02:35.189346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 305/590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:36.053322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:36.057547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:36.061742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:36.062960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:36.063359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:36.064053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:36.064502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:36.064922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:36.093806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a10b4fbe-2858-4ef4-807a-1617347014b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044565 Sep 19 12:02:36.094361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 286/591] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:36.212450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:36.213049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:36.219702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:36.220179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:36.220601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:36.221277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:36.221720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:36.222161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:36.355708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:36.361831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85c8803f-3a7a-4700-b6aa-42eb05025230 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153183 Sep 19 12:02:36.362555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 306/592] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:37.106291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:37.108493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:37.110811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=58 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:37.116288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:37.116861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:37.117373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:37.118182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:37.118707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:37.119219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:37.153814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4bccd4e5-d1e7-485c-a91f-e1092cff5451 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051366 Sep 19 12:02:37.154390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 287/593] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:37.385462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:37.386109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:37.392850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:37.393332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:37.393785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:37.394481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:37.394932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:37.395357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:37.530097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:37.538229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8cfa612-7f61-4997-8ec9-d0a0ec15b4e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156871 Sep 19 12:02:37.538811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 307/594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:38.166968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:38.169173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:38.176448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:38.176931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:38.177365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:38.178136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:38.178620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:38.179082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:38.181543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:38.210057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0fb14bc8-41f7-4483-a756-9e58166c7972 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047111 Sep 19 12:02:38.210617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 288/595] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:38.561895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:38.563001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:38.569436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:38.569955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:38.570392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:38.571111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:38.571567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:38.571991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:38.705396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:38.713232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63e40fdd-2709-44f5-8a6a-f2d9b97df70e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155259 Sep 19 12:02:38.713823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 308/596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:39.223220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:39.225349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:39.231701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:39.232192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:39.232626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:39.233328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:39.233796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:39.234713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:39.264918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-769506eb-8740-4c16-a898-62fd86939058 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045870 Sep 19 12:02:39.265561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 289/597] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:39.736051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:39.736760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:39.742775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:39.743257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:39.743684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:39.744377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:39.744818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:39.745230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:39.882996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:39.891195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-265fb686-9f46-4b4b-a7b8-79df731093c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158879 Sep 19 12:02:39.891760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 309/598] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:39 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:40.277781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:40.279950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:40.286341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:40.286810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:40.287244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:40.287936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:40.288386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:40.288808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:40.318490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28711431-5186-4b1d-bdec-29d0150b314b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044693 Sep 19 12:02:40.319106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 290/599] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:40.914399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:40.915008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:40.917282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:40.923454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:40.923943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:40.924380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:40.925074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:40.925528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:40.925986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:41.055710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:41.063452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3662d782-3aee-4e6f-80ce-1dabf4365e99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152869 Sep 19 12:02:41.065561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 310/600] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:41.331755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:41.334008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:41.340790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:41.341274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:41.341708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:41.342431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:41.342886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:41.343929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:41.375020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c415e331-39a6-416b-8d25-5e5f1c742d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047731 Sep 19 12:02:41.375575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 291/601] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:42.086713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:42.087225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:42.093860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:42.094353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:42.094786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:42.095478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:42.095932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:42.096353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:42.234704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:42.242385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4bdb928-56b0-4874-9f77-64b84a844be1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159813 Sep 19 12:02:42.242994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 311/602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:42.388015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:42.390154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:42.396790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:42.397318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:42.397820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:42.398521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:42.398976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:42.399402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:42.430629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db020a35-3e57-4862-9ba8-6a9605c5b506 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046713 Sep 19 12:02:42.431200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 292/603] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:43.265740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:43.266402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:43.272887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:43.273372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:43.273835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:43.274534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:43.274988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:43.275412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:43.406521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:43.414145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b7bcb5a-56c9-482a-87e0-451b5a6495e1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152392 Sep 19 12:02:43.414710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 312/604] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:43.443575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:43.445714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:43.452144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:43.453451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:43.454048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:43.454798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:43.455253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:43.455677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:43.485388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b1ab238d-71fd-4fa2-a2e8-d102ee58db3c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045821 Sep 19 12:02:43.486174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 293/605] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:44.436585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:44.437187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:44.443539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:44.444013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:44.444436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:44.445112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:44.445556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:44.446016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:44.498390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:44.500434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:44.506849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:44.507326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:44.507757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:44.508449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:44.508892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:44.509307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:44.540301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8cb15062-56df-469b-9aa0-902db3bd6749 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045864 Sep 19 12:02:44.540868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 294/606] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:44.576094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:44.584611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2b023ea-1c3c-4d0f-9f32-d972eb22e777 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151857 Sep 19 12:02:44.585379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 313/607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:45.607872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:45.608599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:45.616117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:45.616598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:45.617034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:45.617742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:45.618222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:45.618649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:45.662959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:45.665856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:45.671894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:45.672579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:45.673188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:45.674128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:45.674804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:45.675435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:45.707548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6a4960b-a691-4fd7-82bb-f4f06b13ab30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157548 Sep 19 12:02:45.708350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 295/608] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:45.762149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:45.770501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e16f5ec-f995-4447-a3eb-8f00d7bf716d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.166536 Sep 19 12:02:45.771045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 314/609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:46.722301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:46.724459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:46.731011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:46.731583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:46.731975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:46.732669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:46.733113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:46.733530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:46.764036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8bf83b73-c419-4f52-9a7a-d0dc6ec6d500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046740 Sep 19 12:02:46.764606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 296/610] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:46.793498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:46.794136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:46.800600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:46.801089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:46.801526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:46.802258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:46.802722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:46.803145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:46.935140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:46.943417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f88161a8-0554-459e-ba45-52842e0bd2b7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153776 Sep 19 12:02:46.943981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 315/611] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:47.776892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:47.779467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:47.790172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:47.790378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:47.790811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:47.791519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:47.791968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:47.792392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:47.824434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9550c084-6603-4e80-9d57-f042cfd3b9bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051576 Sep 19 12:02:47.825023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 297/612] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:47.965948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:47.966560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:47.969552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:02:47.969699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:02:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:02:47.976790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:47.977281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:47.977717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:47.978443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:47.978911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:47.979324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:48.116710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:48.124782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37a2cd55-232a-4df3-8542-5cab134833f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.163026 Sep 19 12:02:48.125347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 316/613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:48.836903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:48.839197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:48.841684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:02:48.841864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments (ip 10.222.0.88) !!! Sep 19 12:02:48.849680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:48.850205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:48.850646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:48.851359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:48.851816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:48.852242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:48.882217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e1704fd7-dae7-433a-97a6-916689dadb3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049284 Sep 19 12:02:48.882781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 298/614] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:49.147875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:49.148409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:49.155298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:49.156434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:49.156842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:49.157538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:49.158021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:49.158443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:49.162531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:49.323261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:49.330982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85c8b789-5282-46eb-a5fd-9825bdd5f9b3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.187311 Sep 19 12:02:49.331554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 317/615] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:49.895433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:49.897604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:49.904178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:49.904674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:49.905115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:49.905916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:49.906653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:49.907093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:49.936579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1528fb7d-1f6e-4394-9ae3-14312dc66a20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045796 Sep 19 12:02:49.937626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 299/616] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:50.355358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:50.355970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:50.363075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:50.363564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:50.364000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:50.364707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:50.365159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:50.365623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:50.501966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:50.509966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eda7aaae-0a04-4165-8f23-f6daf6b08fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158317 Sep 19 12:02:50.510569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 318/617] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:50.949334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:50.951550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:50.958286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:50.958777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:50.959217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:50.959929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:50.960388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:50.960859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:50.991363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2294baea-e109-4fa5-8d19-6a116463468d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Sep 19 12:02:50.994386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 300/618] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:51.533820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:51.534446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:51.540863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:51.541354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:51.541812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:51.542514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:51.542970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:51.543392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:51.676159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:51.683865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c933d75-49f6-4c6f-9aa1-2d4a7ab58553 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154432 Sep 19 12:02:51.684453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 319/619] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:52.003615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:52.005783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:52.013087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:52.013587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:52.014058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:52.015259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:52.015721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:52.016151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:52.046705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-890c37a7-b426-40ea-a66a-ab782eace906 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047073 Sep 19 12:02:52.047155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 301/620] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:52.707023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:52.707570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:52.713976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:52.714460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:52.715149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:52.715838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:52.716308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:52.716713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:52.849736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:52.857470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2e07658-37f8-49d0-8be2-d6ef0d78e98f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154443 Sep 19 12:02:52.858069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 320/621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:53.059433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:53.061661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:53.068213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.068697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.069126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:53.069849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.070301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.070722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:53.100853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c63c1904-b4d3-40dc-97a6-85ae64a09954 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045370 Sep 19 12:02:53.101321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 302/622] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:53.881412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:53.882065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:53.888823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.889306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.890702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:53.891069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.891826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.891979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.027921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:54.035718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b64c4df9-8a50-4787-8a9b-448d06227137 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158491 Sep 19 12:02:54.036310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 321/623] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:54.113961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:54.116155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:54.122846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.123300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.123746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.124882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.125338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.125795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.156310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b32c0a7c-2757-4660-a257-74a3d29505c3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046447 Sep 19 12:02:54.157086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 303/624] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:55.059153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:55.059767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:55.067595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.068101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.068569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.069681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.069825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.070469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.168822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:55.171179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:55.177787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.178380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.179115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.179639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.180163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.180647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.204308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:55.210954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:55.213941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-508da8dc-759e-4d31-9879-d7d13654631c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158576 Sep 19 12:02:55.214951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 322/625] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:55.217476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7e468cc0-2ed0-4cf5-94de-6cb04cca0e4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052670 Sep 19 12:02:55.218240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 304/626] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:02:56.230470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:56.232772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:56.237204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:56.237867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:56.239699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:56.240205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:56.241071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:56.241729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:56.241849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:56.242256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:56.245626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:56.246188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:56.247098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:56.247448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:56.252013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:56.252727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:56.276818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b726e5a3-7311-4bbf-9a92-b57d287e7ca5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050259 Sep 19 12:02:56.277556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 323/627] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:56.446257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:56.454592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf0a7d33-200c-4d0f-b512-84ac324c872f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.221424 Sep 19 12:02:56.455157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 305/628] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:57.290054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:57.292217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:57.302440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:57.302936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:57.303487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:57.304314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:57.304693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:57.305367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:57.345016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7734fa1f-384a-4f6d-a1e8-3b993fd3cc83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058327 Sep 19 12:02:57.345945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 324/629] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:57.478235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:57.478844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:57.485750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:57.486276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:57.486720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:57.487419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:57.487877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:57.488308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:57.619504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:57.627865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6a32be82-b480-4b9e-9932-eb05352c7dc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153484 Sep 19 12:02:57.628539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 306/630] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:58.358157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:58.360972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:58.367672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.368168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.368606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.369308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.369783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.370216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.401016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5aaa1905-a2e9-46d2-b7e5-03d550c4dcf9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046889 Sep 19 12:02:58.401585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 325/631] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:58.651978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:58.652521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:58.659159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.659647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.660086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.660782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.661239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.661665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.790267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:58.797801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28f5d5cb-7f8b-4725-92c0-38a51d83f4de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.149955 Sep 19 12:02:58.798530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 307/632] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:59.414233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:59.416465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:59.423083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:59.423550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:59.424020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:59.424708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:59.425163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:59.425587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:59.457404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2a5e4b4-c777-4fa2-9ae5-a471d3ab2b5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047156 Sep 19 12:02:59.458011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 326/633] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:02:59.820452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:59.821090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:59.827599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:59.828077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:59.828690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:59.829914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:59.830369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:59.830792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:59.964992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:59.972654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-306955fb-66ea-4c22-95fc-a88bf0b3a63e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156086 Sep 19 12:02:59.973226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 308/634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:00.471304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:00.473405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:00.479720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:00.480195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:00.480621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:00.481300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:00.481742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:00.482185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:00.514053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-082c7726-44cc-41e1-9c59-1f9f20e8ed3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047237 Sep 19 12:03:00.514947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 327/635] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:00.995984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:00.996594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:01.003781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.004280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.004752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.005455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.005945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.006373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.135118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:01.143513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c5eeb9fa-afc5-441f-b8c8-7d99de81f4f7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151487 Sep 19 12:03:01.144082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 309/636] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:01.526760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:01.528945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:01.535347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.535830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.536265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.536958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.537413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.537860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.568814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5118f45-580f-4a18-8ce0-d75818c603d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045995 Sep 19 12:03:01.569380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 328/637] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:02.165772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:02.166396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:02.172844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.173329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.173785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.174463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.174909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.175324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.307435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:02.315061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6c17aad7-5579-4c13-b474-60accba4d712 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153218 Sep 19 12:03:02.315612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 310/638] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:02.582112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:02.584255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:02.590878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.591362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.591801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.592497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.592957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.593375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.623790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a50eb0e5-3600-44b6-bb23-cf8c9479bd66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046293 Sep 19 12:03:02.624356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 329/639] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:03.338194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:03.338811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:03.346171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:03.346662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:03.347130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:03.347828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:03.348282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:03.348741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:03.479468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:03.487757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee8450c8-f2f0-480b-ad4a-be4a68dbacf8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153457 Sep 19 12:03:03.488323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 311/640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:03.637069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:03.639239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:03.646175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:03.646662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:03.647108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:03.647798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:03.648252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:03.648676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:03.678905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9fe9326-e4d4-4bc4-a97b-9e5bbf4f8815 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045956 Sep 19 12:03:03.679525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 330/641] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:04.510832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:04.511400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:04.517909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:04.518403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:04.518835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:04.519531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:04.519987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:04.520409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:04.649432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:04.657535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c9923123-c690-45d0-88fe-8ef00f41631b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150802 Sep 19 12:03:04.658135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 312/642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:03:04.691690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:04.693897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:04.700332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:04.700840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:04.701256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:04.701992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:04.702449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:04.702874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:04.733896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d29df4ed-c8c6-4f84-b788-b983afcefe46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046610 Sep 19 12:03:04.734203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 331/643] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:05.681117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:05.681725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:05.689388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:05.689911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:05.690341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:05.691035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:05.691480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:05.691895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:05.746685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:05.748820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:05.755994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:05.756482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:05.756915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:05.757623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:05.758129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:05.758552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:05.791616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d7331ba-732a-42a7-83f9-f051d4bbbb6c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048819 Sep 19 12:03:05.793262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 332/644] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:06.037203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:06.044818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f90a60b7-4a1a-4be0-bd5d-5b87d0119b45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.367815 Sep 19 12:03:06.045382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 313/645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:06.804080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:06.806228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:06.812166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:06.812646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:06.813150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:06.813872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:06.814326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:06.814749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:06.840445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:06.846671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75d3531e-5a76-461e-83e6-3f6e2d90a923 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046713 Sep 19 12:03:06.847353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 333/646] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:07.067692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:07.068304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:07.074878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:07.075365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:07.075804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:07.076504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:07.076967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:07.077396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:07.206637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:07.214856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c6c1659-8741-4c92-993a-9fc3f4346986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150762 Sep 19 12:03:07.215417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 314/647] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:07.860309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:07.862497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:07.869158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:07.869644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:07.870121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:07.870875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:07.871329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:07.871754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:07.901465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ec21b3e-4798-47c3-ab97-127c9aea2676 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045767 Sep 19 12:03:07.902059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 334/648] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:08.237387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:08.238034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:08.240314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=56 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:08.245565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:08.246094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:08.246528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:08.247216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:08.247670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:08.248097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:08.387851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:08.396202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-776bfcd5-4f1c-4349-9ccc-3e1f89c8efea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162725 Sep 19 12:03:08.396768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 315/649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:08.914283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:08.916491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:08.923531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:08.924010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:08.924463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:08.925177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:08.925621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:08.926084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:08.957252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d366ad1d-d36f-4532-94c9-ae42cd7175a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047011 Sep 19 12:03:08.957837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 335/650] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:09.420836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:09.421390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:09.428656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:09.429150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:09.429597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:09.430314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:09.430758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:09.431183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:09.564391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:09.572199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a3142e2-ad43-4a94-a66d-2197559bdd1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156102 Sep 19 12:03:09.572765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 316/651] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:09.970860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:09.973038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:09.979465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:09.979943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:09.980376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:09.981063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:09.981719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:09.981719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:10.011475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-958bf8ac-622c-4c12-bfd6-8fcd358241d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045310 Sep 19 12:03:10.012129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 336/652] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:10.594438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:10.594996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:10.601424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:10.601945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:10.602384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:10.603080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:10.603534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:10.603962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:10.737867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:10.745586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9acb00c1-4c69-4c02-9dc6-3d79d66058a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155217 Sep 19 12:03:10.746258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 317/653] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:11.024750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:11.026900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:11.029186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=54 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:11.035032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:11.035546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:11.035982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:11.036707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:11.037160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:11.037576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:11.068292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2efcf36-bac0-4065-9edf-e41e668ec86e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047484 Sep 19 12:03:11.069173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 337/654] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:11.769696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:11.770336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:11.776958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:11.777451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:11.777925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:11.778631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:11.779099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:11.779514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:11.913197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:11.920920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cad60152-f690-4846-8930-1f5e759b1b80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156246 Sep 19 12:03:11.921484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 318/655] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:12.082167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:12.084329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:12.091011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:12.091551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:12.091985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:12.092696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:12.093150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:12.093577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:12.123939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cbdadd6d-175e-42a5-bee2-3ccdd90a3da7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045980 Sep 19 12:03:12.124502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 338/656] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:12.943734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:12.944277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:12.950842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:12.951314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:12.951749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:12.952445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:12.952965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:12.953328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:13.085158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:13.093042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd580faf-1f8b-40a9-bbc8-5f7db03572c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153267 Sep 19 12:03:13.093613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 319/657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:13.137658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:13.139967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:13.147104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:13.147586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:13.148057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:13.148758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:13.149239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:13.149639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:13.178993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02b523bc-dc7d-4c96-8414-7fa5659b297f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045314 Sep 19 12:03:13.179545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 339/658] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:14.116959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:14.117543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:14.123988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:14.124462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:14.124892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:14.125576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:14.126097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:14.126515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:14.191781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:14.193961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:14.200253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:14.200737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:14.201173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:14.201897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:14.202350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:14.202773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:14.236292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b4401f5-c168-45e1-922f-a95e02208071 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048469 Sep 19 12:03:14.236872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 340/659] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:14.263077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:14.271463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-129e8155-4e70-40e1-a03d-54217bb73138 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158540 Sep 19 12:03:14.272038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 320/660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:15.249013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:15.251673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:15.258208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:15.258631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:15.259083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:15.259770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:15.260222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:15.260643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:15.290028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a30ff5f2-08dc-4cb1-bc4b-a481bff9c097 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Sep 19 12:03:15.290583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 341/661] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:15.294754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:15.295364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:15.301824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:15.302314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:15.302754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:15.303453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:15.303904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:15.304328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:15.319349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:15.435221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:15.443400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ba8284b-2f33-412d-93fd-2ea7762405e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152416 Sep 19 12:03:15.443978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 321/662] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:03:16.303399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:16.305580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:16.312349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:16.312737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:16.313172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:16.313914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:16.314358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:16.314772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:16.347374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b938508-b59b-48ce-b4ae-e9c4face0879 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048649 Sep 19 12:03:16.347963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 342/663] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:16.466730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:16.467333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:16.474391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:16.474878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:16.475313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:16.476022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:16.476461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:16.476881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:16.609590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:16.618027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2bd778cd-9b1e-478c-8df4-0f4cab379f08 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155272 Sep 19 12:03:16.618602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 322/664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:17.362971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:17.365111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:17.372055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:17.372545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:17.372983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:17.373712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:17.374198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:17.374625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:17.405238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-326bcfa8-e1c8-4da1-80d6-b479081ef5a8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046760 Sep 19 12:03:17.405714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 343/665] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:17.642319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:17.642931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:17.649325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:17.649842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:17.650288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:17.650977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:17.651430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:17.651853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:17.779952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:17.788296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8205a778-c4c6-4c0e-8b18-c60d5955b9ca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.149825 Sep 19 12:03:17.788863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 323/666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:18.418113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:18.420257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:18.426777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:18.427263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:18.427700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:18.428392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:18.428845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:18.429268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:18.459042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d1b452a-f4b7-4d95-b48d-b894230b7536 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045244 Sep 19 12:03:18.459605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 344/667] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:18.811597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:18.812197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:18.819219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:18.819706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:18.820143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:18.820844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:18.821296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:18.821724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:18.960038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:18.968014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a073c7a-3434-4a8c-a624-bf0d2c519af5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160281 Sep 19 12:03:18.968583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 324/668] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:19.471880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:19.473933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:19.480255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:19.480730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:19.481163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:19.481908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:19.482359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:19.482878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:19.513822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b245fbfe-04b9-4c09-a243-34267002cae0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045987 Sep 19 12:03:19.514392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 345/669] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:19.992015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:19.992615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:19.998890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:19.999377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:19.999800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:20.000489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:20.000931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:20.001434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:20.136651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:20.144857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a6b6b02-1d95-451e-b749-018623e74189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156583 Sep 19 12:03:20.145430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 325/670] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:20.526627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:20.528909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:20.535569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:20.536054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:20.536489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:20.537217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:20.537675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:20.538232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:20.567827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72e470f7-8b75-440c-8f93-b81b34e577f8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045310 Sep 19 12:03:20.568383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 346/671] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:21.168320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:21.169112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:21.176302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:21.176791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:21.177230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:21.177969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:21.178426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:21.178849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:21.317077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:21.324800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93f7c96c-b9c8-4466-b4cb-c2c396cd03f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160388 Sep 19 12:03:21.325367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 326/672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:21.581223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:21.583409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:21.590018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:21.590505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:21.590938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:21.591620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:21.592068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:21.592474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:21.622075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7718d2dd-b3be-4454-b92a-8e13f159c396 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045485 Sep 19 12:03:21.622642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 347/673] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:22.347955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:22.348602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:22.355247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:22.355745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:22.356184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:22.356889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:22.357414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:22.358110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:22.494457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:22.502603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c1cc98c-0af5-4401-9425-d0c2801de457 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157933 Sep 19 12:03:22.503158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 327/674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:22.634892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:22.636959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:22.643341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:22.643820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:22.644252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:22.644942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:22.645389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:22.645838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:22.674673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e7e4097-55ea-4b44-a773-aa0e601930f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043830 Sep 19 12:03:22.675230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 348/675] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:23.524864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:23.525476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:23.532205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:23.532701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:23.533138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:23.533867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:23.534326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:23.534749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:23.668401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:23.676208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e49c888c-529f-41a6-9af8-3e42e3a2d74e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155256 Sep 19 12:03:23.676777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 328/676] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:23.687453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:23.690228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:23.696542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:23.697017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:23.697449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:23.698697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:23.698697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:23.699033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:23.730363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bee309c-ed2f-4582-9fb2-8bc262fc7485 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046716 Sep 19 12:03:23.730940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 349/677] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:24.698946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:24.699584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:24.706654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:24.707144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:24.707583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:24.708289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:24.708750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:24.709176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:24.743136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:24.745259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:24.751730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:24.752223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:24.752649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:24.753346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:24.753808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:24.754232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:24.772808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:24.788313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c227741c-99c1-4488-a9aa-f7e96f22543c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048550 Sep 19 12:03:24.788313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 350/678] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:24.853616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:24.862172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5fd149de-3a89-4e3d-b2d7-fc7563d167ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.167083 Sep 19 12:03:24.862752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 329/679] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:25.801697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:25.803849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:25.810315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:25.810800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:25.811233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:25.811955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:25.812463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:25.812906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:25.843501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d52ca6fc-947b-458f-a1b6-f58749e24b78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046550 Sep 19 12:03:25.844059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 351/680] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:25.885474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:25.886122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:25.892626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:25.893114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:25.893626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:25.894299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:25.894758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:25.895188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:26.026192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:26.034248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2d6c1b85-6369-4cfc-932f-dc7f661b2fc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152674 Sep 19 12:03:26.034819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 330/681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:26.857846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:26.860198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:26.866572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:26.867053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:26.867474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:26.868155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:26.868597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:26.869018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:26.902552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ef7cdf2-88b9-4fac-b76f-a4ef52861d50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048685 Sep 19 12:03:26.903040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 352/682] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:27.056636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:27.057241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:27.063720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:27.064216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:27.064820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:27.065893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:27.066339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:27.066763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:27.196036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:27.203847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef2044f5-d19c-4292-acf8-520fba214802 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150981 Sep 19 12:03:27.204431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 331/683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:27.916103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:27.918269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:27.924569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:27.925617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:27.926080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:27.926769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:27.927220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:27.927641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:27.956706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d8b22ec-c20e-40ab-98f9-7d3b0ec27252 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044128 Sep 19 12:03:27.957256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 353/684] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:28.232709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:28.233332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:28.240930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:28.241860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:28.242607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:28.243325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:28.243785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:28.244543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:28.385703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:28.393326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63431760-ff12-43e1-9105-a73024cb5b21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.164692 Sep 19 12:03:28.394574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 332/685] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:28.968887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:28.971043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:28.977314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:28.977820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:28.978255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:28.978936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:28.979408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:28.979824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:29.009476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5aaf8cc4-ee5a-4958-917a-cf011c11e548 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044837 Sep 19 12:03:29.010064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 354/686] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:29.415801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:29.416410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:29.422847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:29.423332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:29.423767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:29.424460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:29.424915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:29.425392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:29.557137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:29.565100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6dbfb8d-231c-4210-950b-3d2552761be3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153104 Sep 19 12:03:29.566284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 333/687] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:30.023139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:30.025445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:30.032634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:30.033204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:30.033686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:30.034994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:30.035506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:30.036005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:30.068901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-866a2815-5bb1-4934-bffa-e0f570dc0973 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050126 Sep 19 12:03:30.069462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 355/688] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:30.588525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:30.589311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:30.597964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:30.598465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:30.599587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:30.599716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:30.600103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:30.600528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:30.746965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:30.756057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6c6bfa9-d77e-4dde-843f-b25d558623a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.171689 Sep 19 12:03:30.756837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 334/689] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:31.081924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:31.084060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:31.090760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:31.091238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:31.091663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:31.092468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:31.092909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:31.093329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:31.123251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea24d36c-7a1e-4d97-91b0-2a11ce4236e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045341 Sep 19 12:03:31.123835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 356/690] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:31.782947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:31.784040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:31.793082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:31.793922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:31.794541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:31.795515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:31.796156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:31.796580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:31.935386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:31.943197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eed11457-0208-449f-9912-8e8843f415e8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.164504 Sep 19 12:03:31.943765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 335/691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:32.136561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:32.138867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:32.145928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:32.146367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:32.146820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:32.147516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:32.147963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:32.148379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:32.179343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96501db0-dcd0-411e-96bf-dfca62851420 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047027 Sep 19 12:03:32.180060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 357/692] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:32.967181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:32.967800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:32.974649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:32.975172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:32.975843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:32.976831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:32.977447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:32.978111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:33.117000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:33.125618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4d48dd65-6e9c-4483-910a-4a26b6cf833d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162596 Sep 19 12:03:33.126237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 336/693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:33.192721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:33.194876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:33.201550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:33.202073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:33.202513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:33.203212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:33.203669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:33.204095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:33.235384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be733687-17d8-4be9-b5d7-25d87dc5fcd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046560 Sep 19 12:03:33.235884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 358/694] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:34.148616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:34.149237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:34.155849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:34.156334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:34.156762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:34.157456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:34.157934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:34.158357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:34.247564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:34.249886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:34.259232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:34.259719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:34.260158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:34.260860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:34.261311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:34.261730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:34.290813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:34.297031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37e9ad38-2267-4cd4-a515-c0543ee6e28e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053436 Sep 19 12:03:34.297614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 359/695] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:34.298726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6280d48-e320-465e-bc4c-1b4666543a44 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154335 Sep 19 12:03:34.299290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 337/696] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:34 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:03:35.310292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:35.312448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:35.319293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:35.319768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:35.320200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:35.320889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:35.321332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:35.321751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:35.322588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:35.323197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:35.329858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:35.330351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:35.331379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:35.332082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:35.332542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:35.332964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:35.335709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:35.353991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9346b37d-def6-4e0c-ae32-7976883ce404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047586 Sep 19 12:03:35.354574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 360/697] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:35.468683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:35.476913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2c53220-551f-4d81-9f1e-48602f4cbd69 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158149 Sep 19 12:03:35.477484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 338/698] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:03:36.368264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:36.370441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:36.377105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:36.378328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:36.378830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:36.379602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:36.380056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:36.380480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:36.411827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85a64e65-94d3-42c1-9b2c-b6cad83bd87b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047940 Sep 19 12:03:36.412388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 361/699] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:36.502190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:36.502815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:36.510682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:36.511172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:36.511612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:36.512344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:36.512807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:36.513232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:36.662872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:36.670914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3d702e1-dbb9-4848-8f79-1b81d6746f4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.172693 Sep 19 12:03:36.671436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 339/700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:37.424756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:37.426899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:37.432789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:37.433261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:37.433715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:37.434428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:37.434874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:37.435290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:37.467704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e8f4863-4380-4a11-ae01-cfb5614e156f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047094 Sep 19 12:03:37.468289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 362/701] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:37.694935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:37.695527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:37.702016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:37.702529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:37.702965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:37.703666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:37.704117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:37.704540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:37.837757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:37.845896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3139c004-d0eb-4b8d-bd9f-55f43598ccb2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154949 Sep 19 12:03:37.846489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 340/702] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:38.480986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:38.483300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:38.489896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:38.490387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:38.490823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:38.491522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:38.491977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:38.492402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:38.522540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-376bd58c-7792-41f5-b891-9fd142d72979 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045844 Sep 19 12:03:38.523108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 363/703] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:38.868400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:38.869007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:38.871404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:38.876738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:38.877226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:38.878211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:38.878910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:38.879368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:38.879795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:39.012581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:39.021517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d18e4a82-3cab-4ed7-a200-67b0c6060eac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156345 Sep 19 12:03:39.021517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 341/704] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:39.535217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:39.537444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:39.543828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:39.544307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:39.544739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:39.545425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:39.545894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:39.546313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:39.577154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-711ff125-6b75-434a-ae23-5f4a8e009a1c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045856 Sep 19 12:03:39.577702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 364/705] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:40.042980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:40.043621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:40.050083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:40.050570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:40.051010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:40.051706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:40.052161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:40.052584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:40.189256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:40.197182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5f98d8ea-4414-42eb-83d3-e0d96ee059a2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158077 Sep 19 12:03:40.197744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 342/706] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:40.589317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:40.591799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:40.598170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:40.598646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:40.599071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:40.599752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:40.600196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:40.600608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:40.630908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec057ebf-b62a-41f9-9872-88721d4dd9ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045483 Sep 19 12:03:40.631480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 365/707] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:41.220338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:41.220974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:41.228164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:41.228659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:41.229099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:41.229824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:41.230395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:41.230710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:41.365676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:41.373373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5a0280e0-f745-48d8-8877-a31b037a92d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156902 Sep 19 12:03:41.374009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 343/708] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:41.644596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:41.646671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:41.648939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:41.654973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:41.655466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:41.655932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:41.656630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:41.657085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:41.657663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:41.687789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fa2f97c-58c8-464b-a57f-2e110cf3c4b4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047867 Sep 19 12:03:41.688352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 366/709] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:42.396854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:42.397435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:42.404193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:42.404615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:42.405054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:42.405748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:42.406228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:42.406652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:42.539997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:42.547669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ab6532d-0a4d-43e6-b4d5-b2fde4125c39 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155241 Sep 19 12:03:42.548428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 344/710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:03:42.700660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:42.702782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:42.709746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:42.710255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:42.710693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:42.711375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:42.711845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:42.712264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:42.716093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:42.741602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0fcaa09-980a-4991-b543-13b6b6864aa5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044978 Sep 19 12:03:42.742212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 367/711] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:43.571052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:43.571625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:43.578334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.578829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.579263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.579997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.580505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.580952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.721702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:43.729470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e1164988-d68e-4d1f-8ce3-d0cbfaecc2ab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162412 Sep 19 12:03:43.730085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 345/712] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:43.754975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:43.757296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:43.763741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.764225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.764658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.765345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.765819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.766241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.796424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e98a6a02-396d-485b-9307-4ef4066b660a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045587 Sep 19 12:03:43.796978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 368/713] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:44.755209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:44.755813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:44.762318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:44.762808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:44.763266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:44.763950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:44.764407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:44.764830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:44.808661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:44.810849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:44.818221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:44.818760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:44.819290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:44.820049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:44.820625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:44.821161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:44.854804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36e857f1-650a-4186-a551-00bf23277d92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050048 Sep 19 12:03:44.855742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 369/714] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:44.905990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:44.914103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9dcd0319-2311-4ab2-86b9-e28b586bfb7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162883 Sep 19 12:03:44.914608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 346/715] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:45.868605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:45.870753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:45.876997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.877475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.877940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:45.878663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.879138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.879555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:45.908595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a5ece35-d52c-4361-b3cf-6eb650687e78 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043983 Sep 19 12:03:45.909153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 370/716] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:45.936878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:45.937477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:45.943910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.944395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.944822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:45.945515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.945990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.946414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:46.077596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:46.085744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85d9e9e2-1c0d-4a5a-9838-21c6397e1d51 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152656 Sep 19 12:03:46.086316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 347/717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:46.922008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:46.924084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:46.931064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:46.931545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:46.931979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:46.932672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:46.933128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:46.933549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:46.963516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b9501de-3d5e-4c90-bb42-881717f0574f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045641 Sep 19 12:03:46.964070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 371/718] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:47.109555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:47.110196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:47.117200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:47.117625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:47.118139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:47.118770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:47.119218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:47.119634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:47.256212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:47.263876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f055734-62d0-411d-890e-0702288a494a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158180 Sep 19 12:03:47.264438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 348/719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:47.976643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:47.978760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:47.985121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:47.985604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:47.986067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:47.986747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:47.987194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:47.987609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:48.017855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4885215d-4e8a-4ea1-8b0e-a7e697953faf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045301 Sep 19 12:03:48.018417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 372/720] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:48.286735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:48.287302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:48.293791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:48.294277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:48.294718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:48.295412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:48.295865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:48.296288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:48.428189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:48.435831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-442528bd-5b3c-47c3-9e2b-46cbfbb35e42 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154003 Sep 19 12:03:48.436390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 349/721] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:49.030599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:49.032844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:49.039812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:49.040287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:49.040714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:49.041400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:49.041874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:49.042294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:49.070767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8e677e3-ee86-4003-a812-fe820d91c0c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044174 Sep 19 12:03:49.071312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 373/722] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:49.459755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:49.460356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:49.467170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:49.467659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:49.468096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:49.468790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:49.469253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:49.469679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:49.600232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:49.611277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ef05f0a-b6f7-450b-912e-8d1b646f1e26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155807 Sep 19 12:03:49.612212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 350/723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:50.084029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:50.086194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:50.092779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:50.093252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:50.093682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:50.094388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:50.094830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:50.095242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:50.124675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a43a5c1b-2b68-4a29-b413-9eb16c9250d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Sep 19 12:03:50.125235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 374/724] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:50.635349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:50.635906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:50.642498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:50.642989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:50.643455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:50.644189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:50.644707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:50.645133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:50.786794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:50.794736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93270d31-1127-4247-b39d-aebf8902a90a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.163362 Sep 19 12:03:50.795297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 351/725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:51.137408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:51.139556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:51.145963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:51.146443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:51.146874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:51.147568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:51.148048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:51.148411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:51.178812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34991150-8a57-4182-9274-0d7bb70c2cf6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045403 Sep 19 12:03:51.179357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 375/726] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:51.818354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:51.818959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:51.825256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:51.825734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:51.826193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:51.826887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:51.827336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:51.827759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:51.959139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:51.967152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-01d7d9fb-a84e-46a0-8d38-ccdf6c03292e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153110 Sep 19 12:03:51.967713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 352/727] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:52.191764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:52.193936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:52.200355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:52.200841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:52.201279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:52.201999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:52.202455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:52.202897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:52.231911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93ae9764-3132-4bf6-a2e5-31f17d8d92b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044805 Sep 19 12:03:52.232460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 376/728] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:52.989999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:52.990621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:52.997061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:52.997549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:52.998026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:52.998725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:52.999182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:52.999612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:53.134178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:53.141892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-11c7cd73-0440-4e1b-9853-c9c1bfd533fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155869 Sep 19 12:03:53.142461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 353/729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:53.244687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:53.246920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:53.253210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:53.254224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:53.254658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:53.255357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:53.255809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:53.256233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:53.286090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97b69884-3b1b-499f-95b1-9875fe55b1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045363 Sep 19 12:03:53.286642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 377/730] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:54.165969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:54.166533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:54.172991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:54.173481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:54.173960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:54.174673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:54.175132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:54.176140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:54.299037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:54.301374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:54.308092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:54.308304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:54.308643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:54.309076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:54.309808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:54.310272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:54.310699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:54.311807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:54.317964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e0d1f268-4188-484c-9135-57fb6f1f6150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156169 Sep 19 12:03:54.318565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 354/731] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:54.345363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49d9496a-a8b8-41b3-9039-928fcd4abcc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050333 Sep 19 12:03:54.345975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 378/732] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:55.341964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:55.342594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:55.349489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:55.350002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:55.350435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:55.351187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:55.351707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:55.352050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:55.359467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:55.361997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:55.371186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:55.371672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:55.372108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:55.372806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:55.373250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:55.373686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:55.403867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c18a4973-04aa-4cd0-9c25-4caf69ee1b05 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048805 Sep 19 12:03:55.404456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 379/733] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:03:55.485274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:55.493478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c3f64e35-4d8a-4f4d-98b9-d26776355bae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155721 Sep 19 12:03:55.494078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 355/734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:56.416531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:56.418730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:56.425564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:56.426295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:56.426925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:56.427770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:56.428224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:56.428643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:56.460703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9baa44c4-2b2c-450e-9ebb-3e8df9cc9bfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048121 Sep 19 12:03:56.461273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 380/735] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:56.515551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:56.516159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:56.522666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:56.523142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:56.523574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:56.524258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:56.524703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:56.525120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:56.664662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:56.672736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c911d808-1e74-4923-8a34-4899df03f8ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161078 Sep 19 12:03:56.673307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 356/736] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:03:57.474661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:57.476707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:57.483259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:57.483740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:57.484179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:57.484874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:57.485328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:57.485754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:57.514451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7e5485e-31b8-4ac8-8e61-a941a6e6eb4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044592 Sep 19 12:03:57.515005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 381/737] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:57.697113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:57.697722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:57.704216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:57.704709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:57.705143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:57.705897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:57.707018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:57.707449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:57.840993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:57.849197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-731e1891-461b-4aa6-b98d-f58c75a7be19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156026 Sep 19 12:03:57.849999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 357/738] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:58.527669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:58.529788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:58.536655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:58.537125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:58.537584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:58.538296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:58.538743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:58.539157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:58.569194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c69088b5-004f-464d-a089-927eae24ec3d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045483 Sep 19 12:03:58.569779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 382/739] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:03:58.875161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:58.875765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:58.881709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:58.882230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:58.882668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:58.883362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:58.883814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:58.884237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:59.022012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:59.031233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c1f65390-f016-40cc-be9c-2be26d8ba1e3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160086 Sep 19 12:03:59.031802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 358/740] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:59.583002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:59.585120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:59.591793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:59.592270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:59.592698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:59.593381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:59.593854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:59.594274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:59.620206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:59.625285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4404bc4c-eb26-4146-9c8d-9572af37670c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047261 Sep 19 12:03:59.625852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 383/741] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:03:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:00.057755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:00.058786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:00.065519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:00.066041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:00.066543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:00.067670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:00.068122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:00.068549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:00.198329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:00.205950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-53f770e7-450a-45cb-b37b-d0af884e0558 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154148 Sep 19 12:04:00.206511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 359/742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:00.637516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:00.639675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:00.646958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:00.647454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:00.647892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:00.648593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:00.649050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:00.649477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:00.678696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3cacefe6-e5de-4354-bc5f-e11658eaa6a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045505 Sep 19 12:04:00.679187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 384/743] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:01.229119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:01.229744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:01.236357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:01.236847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:01.237282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:01.238013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:01.238463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:01.239416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:01.374053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:01.384824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0fdb0627-b66b-43bc-93d6-2bd0baa2384d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156731 Sep 19 12:04:01.384824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 360/744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:01.691527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:01.694180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:01.700540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:01.701026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:01.701466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:01.702187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:01.702647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:01.703073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:01.732644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d00f606f-0b80-43cf-b78f-a96277c24e57 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Sep 19 12:04:01.733207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 385/745] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:02.404490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:02.405110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:02.412111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:02.412608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:02.413052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:02.413778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:02.414243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:02.414670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:02.549852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:02.558041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22a29064-88fc-47fb-b178-aae605257573 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157548 Sep 19 12:04:02.558619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 361/746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:02.746011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:02.748070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:02.755260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:02.755741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:02.756177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:02.756876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:02.757329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:02.757752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:02.788017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2e5d23e-4953-4755-ba12-dd99aaa78534 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046094 Sep 19 12:04:02.788604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 386/747] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:03.581275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:03.581940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:03.589032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:03.589834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:03.590277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:03.590971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:03.591428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:03.591852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:03.720650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:03.728316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0081156a-b84f-4d19-a7fc-76db5b02d00d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150949 Sep 19 12:04:03.728882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 362/748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:03.801241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:03.803383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:03.810137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:03.810613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:03.811040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:03.811719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:03.812162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:03.812576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:03.843231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8590ecad-a538-4b8d-a780-57fcf9394b4f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046451 Sep 19 12:04:03.843786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 387/749] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:04.751463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:04.752069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:04.759201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.759675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.760114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.760800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.761283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.761705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.856488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:04.858665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:04.865195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.865682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.866149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.866843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.867290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.867706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.898962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0709243-6d16-4cbf-9a50-27901c58dd83 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046908 Sep 19 12:04:04.899539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 388/750] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:04.899843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:04.909426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-917d3c0a-60e0-489f-a7f7-c757b062a166 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161776 Sep 19 12:04:04.910035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 363/751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:05.911409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:05.913582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:05.921188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:05.922114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:05.922900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:05.923977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:05.924446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:05.924879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:05.932403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:05.933016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:05.939375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:05.939877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:05.940300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:05.941002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:05.941457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:05.941905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:05.957375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8caefc07-f82f-4270-b0a1-d8cf074cb3f9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050446 Sep 19 12:04:05.957976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 389/752] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:06.075511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:06.083365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49c44884-4677-40bf-9cb9-089bf69b1a9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154798 Sep 19 12:04:06.083927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 364/753] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:06.970653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:06.972716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:06.978633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:06.979107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:06.979534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:06.980210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:06.980672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:06.981112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:07.011131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e4f96af-4d10-4ed4-8dc2-9e49a8f489fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044655 Sep 19 12:04:07.011686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 390/754] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:07.106458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:07.107073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:07.113485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:07.114521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:07.114960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:07.115650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:07.116105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:07.116529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:07.257231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:07.265151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2bf81221-a12b-48b5-91d1-d7656c2642bf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162541 Sep 19 12:04:07.265720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 365/755] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:08.024492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:08.026667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:08.033250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:08.033727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:08.034201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:08.034893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:08.035341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:08.035763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:08.065900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d0eba06-a436-486d-8788-3b128e3aacba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045948 Sep 19 12:04:08.066463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 391/756] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:08.288260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:08.288800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:08.295370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:08.295968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:08.296302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:08.297003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:08.297455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:08.297908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:08.429284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:08.436904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-56ee70cb-6102-4fef-8c29-80450ddec359 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152634 Sep 19 12:04:08.437468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 366/757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:09.079426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:09.081545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:09.087871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:09.088350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:09.088786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:09.089468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:09.090198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:09.090623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:09.120784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e4ae008-bd7d-49a1-8c8c-61dd8ca978ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045309 Sep 19 12:04:09.121331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 392/758] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:09.460030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:09.460636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:09.463086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:09.468668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:09.469164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:09.469602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:09.470339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:09.470798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:09.471223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:09.601126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:09.608751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58cdf8b9-1eb8-4330-b8ea-13cf954f48b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153011 Sep 19 12:04:09.609255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 367/759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:10.134237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:10.136340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:10.142690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:10.143170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:10.143597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:10.144283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:10.144732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:10.145184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:10.173947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9b52a77-bdd9-477f-8b25-29993e42b7d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044397 Sep 19 12:04:10.174503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 393/760] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:10.631724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:10.632327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:10.638853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:10.639330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:10.639762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:10.640447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:10.640896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:10.641317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:10.774081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:10.781825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4a4eba3-7a81-4687-9cf0-80013247030f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153958 Sep 19 12:04:10.782396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 368/761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:11.186196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:11.188373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:11.195272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:11.195750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:11.196185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:11.196876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:11.197329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:11.197748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:11.227479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e45a617-32c1-4918-9109-272dd47212fc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045297 Sep 19 12:04:11.228114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 394/762] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:11.806037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:11.806649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:11.813011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:11.813491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:11.813965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:11.814651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:11.815104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:11.815517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:11.955166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:11.963386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f12bb25-c04a-44ef-b66a-fcf32505bdbd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161861 Sep 19 12:04:11.963974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 369/763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:12.240778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:12.243038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:12.245319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:12.250789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:12.251279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:12.251724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:12.252429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:12.252882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:12.253309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:12.284440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef766ef9-02a6-462b-8380-18e98b469228 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048090 Sep 19 12:04:12.285005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 395/764] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:12.990617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:12.991140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:12.997617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:12.998130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:12.998566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:12.999260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:12.999715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:13.000146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:13.136664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:13.144525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-614a2869-699b-4723-b7fa-6644ea14fb9d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157801 Sep 19 12:04:13.145584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 370/765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:13.297837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:13.299968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:13.306775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:13.307485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:13.308123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:13.308829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:13.309285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:13.309797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:13.341884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4b9430c-28e7-4970-8520-dd44d98ad54b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048188 Sep 19 12:04:13.342444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 396/766] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:14.167958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:14.168560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:14.175343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:14.175820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:14.176885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:14.177579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:14.178048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:14.178468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:14.195049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:14.309153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:14.317026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-40eda79d-066c-43c6-9ea6-fea8563618ea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152775 Sep 19 12:04:14.317537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 371/767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:14.354027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:14.356348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:14.362889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:14.363370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:14.364365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:14.365061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:14.365509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:14.365956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:14.395738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47cdbbb1-a54c-4ac2-a284-2f9c39c20907 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045244 Sep 19 12:04:14.396299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 397/768] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:15.339943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:15.340552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:15.346958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:15.347441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:15.347876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:15.348568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:15.349024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:15.349449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:15.408513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:15.410778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:15.417171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:15.417712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:15.418125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:15.418826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:15.419338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:15.419829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:15.451870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35009653-ffd3-4398-a05f-1564333bf15f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047344 Sep 19 12:04:15.452447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 398/769] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:15.483178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:15.491483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9cd61e4e-eb48-4fa0-a634-04d93cf85a4d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155659 Sep 19 12:04:15.492049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 372/770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:16.465225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:16.467309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:16.473630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:16.474133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:16.474562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:16.475240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:16.475683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:16.476092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:16.505266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3efd9ebe-4d71-4ab1-8782-35f18ce808e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044355 Sep 19 12:04:16.505893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 399/771] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:16.515856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:16.516464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:16.523842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:16.524330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:16.525361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:16.526092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:16.526551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:16.526977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:16.659492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:16.667164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51c1019d-3544-4f17-8dcd-1b58c33ba3ed tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155894 Sep 19 12:04:16.667744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 373/772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:17.517040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:17.519192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:17.526010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:17.526490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:17.526952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:17.527648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:17.528091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:17.528509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:17.545609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:17.559051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2df26272-721e-4782-8438-77a368f3869c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045987 Sep 19 12:04:17.559520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 400/773] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:17.690133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:17.690748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:17.697185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:17.697673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:17.698144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:17.698849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:17.699306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:17.699733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:17.830659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:17.839044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e1d3da0-01f1-4cb3-9322-a0656a683612 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152689 Sep 19 12:04:17.839868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 374/774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:18.571579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:18.573780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:18.580169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:18.580653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:18.581082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:18.581785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:18.582237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:18.582655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:18.612194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a36f69a-1204-4696-9427-ca2f519acae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044591 Sep 19 12:04:18.612756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 401/775] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:18.862002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:18.862627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:18.869869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:18.870355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:18.870788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:18.871480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:18.871927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:18.872346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:19.008780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:19.016889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4568c2fe-ded3-47a2-bee8-9f3cfd1763a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158725 Sep 19 12:04:19.017566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 375/776] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:19.625895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:19.628074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:19.635123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:19.635605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:19.636045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:19.636747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:19.637201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:19.637633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:19.666660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f44df46-b8b4-4291-9524-4932c6ec13a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044758 Sep 19 12:04:19.667143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 402/777] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:20.040993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:20.041623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:20.048038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:20.048517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:20.048946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:20.049691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:20.050103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:20.050519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:20.179718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:20.187711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab27f237-b534-473a-84c6-110eb43bd3d4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150522 Sep 19 12:04:20.188278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 376/778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:20.679365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:20.681461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:20.687866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:20.688354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:20.688790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:20.689484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:20.689970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:20.690401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:20.719882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14ed3daf-23c3-42c1-954e-f35bee3b796b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044625 Sep 19 12:04:20.720445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 403/779] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:21.209464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:21.210107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:21.217078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:21.217567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:21.218031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:21.218726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:21.219178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:21.219600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:21.356133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:21.368334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c934bc38-8502-4c79-809c-8071b14bcfc8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162539 Sep 19 12:04:21.368976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 377/780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:21.733326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:21.735435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:21.742351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:21.742839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:21.743272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:21.743966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:21.744421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:21.744853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:21.773902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fb41547-eaba-41bb-b53b-fe63f31dde85 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044623 Sep 19 12:04:21.774463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 404/781] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:22.392516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:22.393070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:22.400357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:22.400847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:22.401283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:22.402014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:22.402502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:22.403107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:22.539119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:22.546910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28614b44-fd57-405e-aa9f-a452d27fb552 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158503 Sep 19 12:04:22.547485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 378/782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:22.785930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:22.788068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:22.794432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:22.794915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:22.795354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:22.796038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:22.796488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:22.796909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:22.827567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62699714-9aa5-44a0-9de4-74a8afa402d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045645 Sep 19 12:04:22.828131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 405/783] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:23.569384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:23.570026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:23.576570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:23.577057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:23.577497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:23.578236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:23.578697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:23.579124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:23.711892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:23.719933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-00f49805-6f07-48a4-8050-57e0634ee265 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154413 Sep 19 12:04:23.720505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 379/784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:23.840742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:23.842970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:23.849321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:23.849846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:23.850284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:23.850973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:23.851422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:23.851845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:23.882157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7b75430-50f2-401d-9642-ee1a1d573ce4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045730 Sep 19 12:04:23.882723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 406/785] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:24.743507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:24.744133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:24.750592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:24.751078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:24.751505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:24.752194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:24.752639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:24.753057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:24.887101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:24.896315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:24.896858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2c4ac956-aec9-4961-ad78-a58bd00be4ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156778 Sep 19 12:04:24.897379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 380/786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:04:24.898686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:24.904994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:24.905583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:24.906001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:24.906793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:24.907239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:24.907649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:24.941502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f6f5ba2-fb1d-4c80-9888-10d17ac823ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050679 Sep 19 12:04:24.942079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 407/787] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:25.919891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:25.920500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:25.927470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:25.927984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:25.928417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:25.929101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:25.929553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:25.930002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:25.954390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:25.956515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:25.958573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:04:25.958716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:04:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments (ip 10.222.0.88) !!! Sep 19 12:04:25.965672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:25.966189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:25.966620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:25.967347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:25.967812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:25.968220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:26.001724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-585bb6b6-384f-4ce9-b11f-c84e00904cfe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051423 Sep 19 12:04:26.002319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 408/788] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:26.071226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:26.079060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-746ebc71-e95a-4856-a051-7e0faace963f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.163102 Sep 19 12:04:26.079638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 381/789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:27.015252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:27.017733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:27.025540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:27.025995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:27.026423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:27.027111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:27.027553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:27.028078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:27.063716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ae00138-d2e9-44cb-840d-4269afae0780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052440 Sep 19 12:04:27.064286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 409/790] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:27.102426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:27.103039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:27.109577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:27.110111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:27.110552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:27.111250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:27.111705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:27.112132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:27.244539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:27.252325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f559051f-3a9f-413e-807f-2c6112780d29 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153898 Sep 19 12:04:27.252887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 382/791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:28.076834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:28.079011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:28.086216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:28.086699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:28.087138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:28.087866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:28.088319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:28.088742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:28.118892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7aca24b-20d0-4d46-a7ab-9468f234accc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045979 Sep 19 12:04:28.119377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 410/792] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:28.276600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:28.277238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:28.283353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:28.283837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:28.284272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:28.284959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:28.285414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:28.285858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:28.414321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:28.421990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e00e8740-44b5-4baf-951b-20d7c3c8eb5a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.149679 Sep 19 12:04:28.422559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 383/793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:29.131794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:29.134098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:29.140670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:29.141161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:29.141602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:29.142378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:29.142829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:29.143253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:29.173090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2860e4e-d90e-4b63-ad87-d720fe0579f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045308 Sep 19 12:04:29.173581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 411/794] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:29.444725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:29.445268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:29.452009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:29.452485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:29.452914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:29.453607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:29.454078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:29.454499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:29.600403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:29.608151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9882b897-f75b-4c4c-9905-6bb84f5fdfcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.167376 Sep 19 12:04:29.608726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 384/795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:30.186791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:30.188932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:30.195994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:30.196465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:30.196890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:30.197573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:30.198049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:30.198490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:30.228049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f79ac461-da4e-4017-986e-d9dd992b63dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045215 Sep 19 12:04:30.228536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 412/796] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:30.631076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:30.631683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:30.638627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:30.639127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:30.639566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:30.640276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:30.640733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:30.641161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:30.771393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:30.778974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7d3859be-2c08-4228-bb71-c73b17218b99 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151968 Sep 19 12:04:30.779604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 385/797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:31.240643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:31.242806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:31.249433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:31.249997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:31.250572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:31.251320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:31.251777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:31.252203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:31.282985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-622e2063-c6fd-477c-b449-740c99ca2203 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046296 Sep 19 12:04:31.283476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 413/798] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:31.802900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:31.803503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:31.810080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:31.810573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:31.811008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:31.811709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:31.812167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:31.812630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:31.943924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:31.951581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea9df2e4-e0b8-45cc-90ce-ba5a1e7937fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153124 Sep 19 12:04:31.952148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 386/799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:32.296328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:32.298511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:32.305381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:32.305892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:32.306330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:32.307022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:32.307469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:32.307886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:32.339292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a27f90c2-917c-4eef-952e-87a9a8367fe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046999 Sep 19 12:04:32.340121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 414/800] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:32.975270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:32.975860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:32.983437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:32.983939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:32.984382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:32.985108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:32.985556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:32.985999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:33.128074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:33.137684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f7a4301-d38d-4f23-8602-3015a75ba030 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.166324 Sep 19 12:04:33.138275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 387/801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:33.352944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:33.355216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:33.361598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:33.362104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:33.362615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:33.363218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:33.363660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:33.364075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:33.393357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c68d4d58-acac-40bb-a470-59644efb4330 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045068 Sep 19 12:04:33.394141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 415/802] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:34.162305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:34.162919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:34.169333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:34.169854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:34.170292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:34.170987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:34.171447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:34.171872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:34.174448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:34.305369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:34.313181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94816d55-3aaa-4758-a5dc-5bcf6cd6bd25 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155416 Sep 19 12:04:34.313746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 388/803] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:34 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:34.406120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:34.408160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:34.415304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:34.415784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:34.416212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:34.416898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:34.417344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:34.417785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:34.447441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a9b0403-16be-4022-ae7c-5e5cf96c6ec6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045435 Sep 19 12:04:34.447994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 416/804] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:35.337274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:35.337930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:35.344731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:35.345217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:35.345685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:35.346447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:35.346895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:35.347318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:35.460649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:35.463016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:35.469588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:35.470145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:35.470536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:35.471239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:35.471691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:35.472143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:35.476823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:35.481886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:35.489822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b57ad82a-e59a-4305-a46d-258ba9c9b413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156324 Sep 19 12:04:35.490408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 389/805] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:35.503598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f97aa2c-2767-4771-8baa-1575db681856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047422 Sep 19 12:04:35.504157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 417/806] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:36.512704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:36.513244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:36.516178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:36.518386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:36.519832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:36.520322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:36.520754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:36.521458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:36.521938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:36.522371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:36.524717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:36.525204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:36.525639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:36.526370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:36.526952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:36.527367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:36.558025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e71c7954-b687-44a4-a776-6b4716cbd0b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045695 Sep 19 12:04:36.558600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 418/807] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:36.656781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:36.664948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-447eee25-061f-41ae-a868-caa819d315a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156253 Sep 19 12:04:36.665526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 390/808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:37.570907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:37.573070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:37.578907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:37.579385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:37.579823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:37.580513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:37.580969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:37.581387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:37.611630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c865a50a-6638-4f5a-adf6-7c9fbe862a3a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044894 Sep 19 12:04:37.612195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 419/809] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:37.689410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:37.689988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:37.696435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:37.696921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:37.697354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:37.698178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:37.698541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:37.699016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:37.830508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:37.838843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-77185564-4ef6-4104-aa48-d846be286b67 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153468 Sep 19 12:04:37.839384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 391/810] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:38.624736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:38.626878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:38.633428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:38.633943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:38.634374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:38.635058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:38.635502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:38.635919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:38.665669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46a69eba-4b30-4337-8dca-33867f91584c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044922 Sep 19 12:04:38.666242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 420/811] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:38.862307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:38.862896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:38.869210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:38.869710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:38.870161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:38.870851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:38.871303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:38.871730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:39.006813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:39.014599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0e016c3e-ae1e-4d45-960e-3cfd97d92d8c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156116 Sep 19 12:04:39.015319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 392/812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:39.677504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:39.679734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:39.686150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:39.686635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:39.687062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:39.687746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:39.688193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:39.688621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:39.719409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f367c11-f00f-4437-839a-86814cf4f1df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045875 Sep 19 12:04:39.719967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 421/813] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:40.039018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:40.039625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:40.041941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:40.047194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:40.047673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:40.048106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:40.048792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:40.049240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:40.049659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:40.181677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:40.189414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-01a4677d-6de8-419a-9bca-2d0c30203f20 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155117 Sep 19 12:04:40.190026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 393/814] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:40.732283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:40.734518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:40.741419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:40.741934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:40.742368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:40.743086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:40.743536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:40.743953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:40.773614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d24aa6af-e0ca-4fe1-b953-ef410fd46b06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045438 Sep 19 12:04:40.774196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 422/815] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:41.212617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:41.213229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:41.219954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:41.220437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:41.220872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:41.221566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:41.222043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:41.222468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:41.355190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:41.362962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-159b2f27-89dd-4f83-ab6b-d4a08f7865e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154178 Sep 19 12:04:41.364041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 394/816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:41.786530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:41.788667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:41.795018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:41.795499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:41.795939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:41.796633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:41.797089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:41.797510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:41.826937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b5c84c0-2c47-4305-838a-5ee413839118 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044872 Sep 19 12:04:41.827502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 423/817] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:42.386703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:42.387345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:42.393852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:42.395194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:42.395636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:42.396332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:42.396789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:42.397217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:42.536553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:42.544836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5035ca1d-9a01-4357-a9af-0805cf1cb937 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161997 Sep 19 12:04:42.545405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 395/818] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:04:42.840082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:42.842301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:42.844575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:42.849577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:42.850098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:42.850535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:42.851308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:42.851687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:42.852107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:42.884277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-07119de3-894d-46b5-8903-ae54a5618655 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048405 Sep 19 12:04:42.884845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 424/819] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:43.568507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:43.569163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:43.575535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:43.576028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:43.576456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:43.577343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:43.577891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:43.578390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:43.714322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:43.722362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1462e981-1907-4f1d-93bd-018637965326 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158227 Sep 19 12:04:43.723089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 396/820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:43.897142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:43.899222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:43.905552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:43.906058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:43.906491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:43.907176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:43.907621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:43.908040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:43.937502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2c7a08d-9a4a-491e-8fed-79f1f7a8c5dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Sep 19 12:04:43.938091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 425/821] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:44.745380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:44.746020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:44.752516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:44.753010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:44.753451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:44.754704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:44.755162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:44.755591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:44.899412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:44.911333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5dd943eb-0f96-483b-ad71-798dc1dd1fb1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.169792 Sep 19 12:04:44.912016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 397/822] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:44.951126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:44.953222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:44.960323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:44.960837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:44.961280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:44.961993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:44.962476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:44.962868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:44.992213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1f2c746-bb9c-4ee6-9c31-9f4c75e960a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045269 Sep 19 12:04:44.992770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 426/823] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:45.935355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:45.936077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:45.942598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:45.943082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:45.943516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:45.944206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:45.944656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:45.945079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:46.004876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:46.007044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:46.013653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:46.014180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:46.014616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:46.015311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:46.015761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:46.016179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:46.047465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-760aa1e7-9cf1-4281-a544-325981ce197f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046531 Sep 19 12:04:46.048030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 427/824] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:46.074630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:46.082900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82488163-e95a-43b4-a336-334afaffb6ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151796 Sep 19 12:04:46.083460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 398/825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:04:47.060147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:47.062366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:47.069339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:47.069852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:47.070288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:47.072041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:47.072495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:47.072917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:47.102996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3eea3622-e5cf-471a-bc22-1a527ba74475 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046897 Sep 19 12:04:47.103730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 428/826] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:47.106305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:47.106941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:47.112990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:47.113482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:47.113954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:47.114658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:47.115114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:47.115540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:47.251920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:47.260176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8caf7fa8-8d3d-40c7-8fd1-eb31eae2d8ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158416 Sep 19 12:04:47.260739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 399/827] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:04:48.117106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:48.119275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:48.125647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:48.126190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:48.126626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:48.127326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:48.127781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:48.128202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:48.158480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b528f68-1c2f-42fa-96e9-09994c96f31a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046318 Sep 19 12:04:48.159036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 429/828] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:48.283398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:48.283996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:48.291029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:48.291511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:48.291940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:48.292635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:48.293084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:48.293506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:48.425949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:48.433552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e9e7579b-faac-48b6-8570-ba202120fd66 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154057 Sep 19 12:04:48.434148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 400/829] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:49.171979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:49.174428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:49.181158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:49.181646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:49.182110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:49.182803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:49.183254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:49.183673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:49.213489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70b8e86d-14d8-42b0-a372-f793cfb274b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045485 Sep 19 12:04:49.214073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 430/830] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:49.456167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:49.456782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:49.463570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:49.464059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:49.464742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:49.465446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:49.465933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:49.466359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:49.600252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:49.608329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80b6a852-db10-41a1-aa54-f72bf3d117f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155985 Sep 19 12:04:49.608924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 401/831] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:50.226620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:50.228770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:50.235339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.235813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.236264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.236940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.237381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.237812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.266845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1b5d7b0-cfbc-4d59-a15b-e5d26dea11fb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044278 Sep 19 12:04:50.267388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 431/832] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:50.632996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:50.633601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:50.640137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.640663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.641067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.641797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.642256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.642682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.772252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:50.780005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-35f99b7f-3cc9-4349-b2cb-bbc4616a9b10 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151431 Sep 19 12:04:50.780806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 402/833] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:51.280226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:51.282388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:51.289676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:51.290269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:51.290698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:51.291388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:51.291831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:51.292249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:51.321474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf5ffad0-e56a-42e0-a0de-4fba39db1cdc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045129 Sep 19 12:04:51.321981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 432/834] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:51.805608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:51.806247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:51.812892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:51.813375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:51.813820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:51.814512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:51.814962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:51.815379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:51.946904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:51.954583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-620eecbc-8b30-44d0-bc13-2c90bae34cb6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152931 Sep 19 12:04:51.955150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 403/835] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:52.334486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:52.336596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:52.343106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:52.343581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:52.344017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:52.344693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:52.345138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:52.345551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:52.371305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:52.377181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca37bc29-bf02-4d6e-b883-0da78fe398d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047312 Sep 19 12:04:52.377755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 433/836] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:52.977857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:52.978466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:52.984808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:52.985292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:52.985720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:52.986427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:52.986873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:52.987291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:53.122077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:53.124263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:53.131830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0f933c7-80c7-4828-b287-abac1689a7fa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157712 Sep 19 12:04:53.132411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 404/837] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:04:53.391146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:53.393317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:53.399831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:53.400311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:53.400747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:53.401439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:53.402042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:53.402468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:53.432537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bb62a10-721a-4d70-8fe1-4636b41c1615 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045374 Sep 19 12:04:53.433091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 434/838] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:54.154411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:54.155025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:54.162040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:54.163069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:54.163539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:54.164320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:54.164777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:54.165204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:54.311430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:54.319662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb346d69-3224-4a7e-baff-eb33526c6380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.169024 Sep 19 12:04:54.320251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 405/839] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:54.446197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:54.448328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:54.454760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:54.455239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:54.455671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:54.456366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:54.456818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:54.457239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:54.488003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5b5b7f5-38f3-439e-9d32-0df13b539df8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046724 Sep 19 12:04:54.488583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 435/840] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:55.344135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:55.344777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:55.351890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:55.352378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:55.352819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:55.353518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:55.353999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:55.354423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:55.491460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:55.499358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a7f8e4f-f6c5-4abe-b259-c3d88fd57b82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159735 Sep 19 12:04:55.500042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 406/841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:55.500539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:55.502876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:55.509138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:55.509617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:55.510186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:55.510802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:55.511256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:55.511681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:55.541397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1abdda2-529f-49e3-b342-09054b65472a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044757 Sep 19 12:04:55.542128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 436/842] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:04:56.521780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:56.522581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:56.529283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:56.529803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:56.530250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:56.530958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:56.531414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:56.531847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:56.558961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:56.562354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:56.572789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:56.573409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:56.574060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:56.574921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:56.575471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:56.576014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:56.609881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f1320d7-0134-447b-be7d-663ab329ddf7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058283 Sep 19 12:04:56.610392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 437/843] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:56.679627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:56.687580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bcf2a896-7bb7-486f-902b-61d082538cc5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.169710 Sep 19 12:04:56.688153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 407/844] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:57.622618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:57.624779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:57.627868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:04:57.628030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:04:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments (ip 10.222.0.88) !!! Sep 19 12:04:57.638092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.638946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.639396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.640106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.640564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.640987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.674028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-446ef1e7-f17a-49e5-bedf-c2b3b67301b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055414 Sep 19 12:04:57.674592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 438/845] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:57.711903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:57.712508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:57.719176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.719658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.720089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.720778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.721226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.721647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.853712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:57.861531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96327f5c-ed13-4425-9bbb-f2eed82dd483 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154132 Sep 19 12:04:57.862129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 408/846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:58.686761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:58.688900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:58.695271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:58.695757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:58.696192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:58.696885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:58.697341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:58.697796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:58.728059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83d2c53d-b368-4a1d-88cd-871ebb41057e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045277 Sep 19 12:04:58.728620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 439/847] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:04:58.884873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:58.885399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:58.891593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:58.892082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:58.892516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:58.893234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:58.893713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:58.894196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.023653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:59.031261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-629ec7c0-1730-4cb0-97f6-a5d245e499d1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150465 Sep 19 12:04:59.031824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 409/848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:59.741276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:59.743432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:59.749729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.750232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.750658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.751338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.751782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.752200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.781476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb521546-b1de-41fe-afba-dde5511e5b29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044855 Sep 19 12:04:59.782061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 440/849] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:04:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:00.054853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:00.055490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:00.061901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.062386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.062810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.063498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.063944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.064359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.194600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:00.202531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78907572-84fe-44a7-b5c4-8369c6c17ebc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152620 Sep 19 12:05:00.203100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 410/850] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:00.794835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:00.797062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:00.804272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.804745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.805172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.805917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.806363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.806835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.836352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c350d735-4b5a-45be-8f89-7173a9d6e747 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045447 Sep 19 12:05:00.836996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 441/851] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:01.225883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:01.226522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:01.233024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:01.233505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:01.233966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:01.234655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:01.235105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:01.235525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:01.372567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:01.381546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb6ac916-75ba-4be6-b9d5-7785ecf656ff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159117 Sep 19 12:05:01.382089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 411/852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:01.848486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:01.851296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:01.857682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:01.858199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:01.858627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:01.859316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:01.859764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:01.860182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:01.888990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f694b69-2788-4a60-8547-0c30ba7757ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Sep 19 12:05:01.889545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 442/853] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:02.408891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:02.409542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:02.416157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:02.416638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:02.417072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:02.417789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:02.418234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:02.418655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:02.701423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:02.709027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fafc1328-7530-4b14-b6b3-57f337117ad9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.304172 Sep 19 12:05:02.709588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 412/854] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:02.901178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:02.903337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:02.909629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:02.910139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:02.910572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:02.911780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:02.912232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:02.912649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:02.942035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd89968b-eba2-4f67-946c-9deaece749f4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044797 Sep 19 12:05:02.942585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 443/855] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:03.732528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:03.733089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:03.739441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:03.739916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:03.740351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:03.741069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:03.741516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:03.741968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:03.877750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:03.886173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-44598115-eb53-431a-bf78-8f31e29b4bf1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157542 Sep 19 12:05:03.886739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 413/856] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:03.954581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:03.956700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:03.963049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:03.963534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:03.963974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:03.964926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:03.965379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:03.965826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:03.996299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4214de95-45e4-4b9c-bcea-75a453717636 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045629 Sep 19 12:05:03.996799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 444/857] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:04.909457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:04.910085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:04.917201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:04.917687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:04.918152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:04.918840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:04.919293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:04.919716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:05.009132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:05.017819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:05.018787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:05.019281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:05.019790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:05.020519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:05.021728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:05.022267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:05.052199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5ec23a2-4090-42f2-b7c4-2bcab91d6d81 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047442 Sep 19 12:05:05.052766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 445/858] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:05.053014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:05.060808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-393bb6af-9671-4128-875b-26bca3d3acb0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155196 Sep 19 12:05:05.061359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 414/859] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:06.064604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:06.066800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:06.073817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:06.074296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:06.074723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:06.075401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:06.075843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:06.076263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:06.083822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:06.084434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:06.091315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:06.091809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:06.092249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:06.092954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:06.093416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:06.093892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:06.106164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2db9b3b1-2077-4e0d-af9d-5b59a5e59568 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045501 Sep 19 12:05:06.106728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 446/860] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:06.220852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:06.228593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f90fec28-5b3c-40e7-b895-e37df44328cb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.148686 Sep 19 12:05:06.229157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 415/861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:05:07.118883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:07.121152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:07.127327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:07.127800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:07.128226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:07.128913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:07.129357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:07.129827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:07.159688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae40938c-2e5a-4b26-8ffd-46ea24632339 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044958 Sep 19 12:05:07.160235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 447/862] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:07.251621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:07.252251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:07.258735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:07.259212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:07.259639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:07.260324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:07.260767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:07.261182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:07.393144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:07.400779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-168e7dd2-8933-471c-8ed8-226b568a06bc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152991 Sep 19 12:05:07.401346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 416/863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:08.172822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:08.175039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:08.181584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:08.182111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:08.182547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:08.183279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:08.183934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:08.184151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:08.214842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18616344-4c8d-4d4b-9952-cb39923b31cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045690 Sep 19 12:05:08.215401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 448/864] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:08.424295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:08.424879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:08.431690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:08.432170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:08.432595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:08.433280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:08.433733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:08.434181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:08.562263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:08.570614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e5ddd064-f9e5-4793-9aa5-053267839ccc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150253 Sep 19 12:05:08.571614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 417/865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:09.227584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:09.229833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:09.236162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:09.236650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:09.237086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:09.237808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:09.238263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:09.238690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:09.269531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bf5a524-d465-45a3-9782-c517f636548f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045969 Sep 19 12:05:09.270121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 449/866] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:09.594331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:09.594920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:09.602013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:09.602506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:09.602945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:09.603642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:09.604109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:09.604541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:09.744093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:09.752085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d2f6e15-e967-4745-a6a2-fdc7bc45d28d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161508 Sep 19 12:05:09.752651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 418/867] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:10.295629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:10.297824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:10.304319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:10.304797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:10.305227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:10.305939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:10.306390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:10.306805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:10.324011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:10.338241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a1f6564-406c-44b4-9d40-ac048d423372 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047045 Sep 19 12:05:10.338788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 450/868] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:10.775081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:10.775663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:10.778116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:10.783344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:10.783826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:10.784262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:10.784953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:10.785405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:10.785848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:10.917457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:10.925184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3dd204f3-4bb8-49c1-8ce4-18d7b355cb45 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153976 Sep 19 12:05:10.925752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 419/869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:11.351351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:11.353677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:11.360439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:11.361196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:11.361630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:11.362425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:11.362959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:11.363288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:11.393816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5afda7d5-ca52-413b-9fbe-ac661ce662ed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046912 Sep 19 12:05:11.394389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 451/870] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:11.948730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:11.949324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:11.955748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:11.956234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:11.956661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:11.957344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:11.957814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:11.958236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:12.091078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:12.098600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-20719018-e720-43e5-9dd6-c36643b428a8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153797 Sep 19 12:05:12.099158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 420/871] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:12.407577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:12.409878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:12.426933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:12.427349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:12.427904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:12.428908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:12.429412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:12.429882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:12.466441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c341c7b8-5b6b-4833-98fd-3e6d8dcd7b7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063022 Sep 19 12:05:12.467003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 452/872] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:13.122307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:13.122957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:13.129469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:13.129994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:13.130433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:13.131133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:13.132146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:13.132580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:13.147646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:13.468743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:13.477391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df86f8d5-3eb0-4102-b0e1-f9a8dcd373ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.358855 Sep 19 12:05:13.478410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 421/873] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:13.494721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:13.494721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:13.494721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:13.494721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:13.495428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:13.495428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:13.495428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:13.495428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:13.495866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:13.531727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-118bdee5-43fe-4de4-b12c-5cdfcd18ad22 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056193 Sep 19 12:05:13.532294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 453/874] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:14.502209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:14.502871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:14.509837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:14.510329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:14.510757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:14.511501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:14.511905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:14.512322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:14.550323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:14.550323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:14.555728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:14.556464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:14.557084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:14.560210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:14.560684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:14.561333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:14.596918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91688877-9573-49cd-8231-ec2a130d8e66 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055860 Sep 19 12:05:14.597937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 454/875] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:14.656506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:14.664871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7d084bb-a134-4a7d-bef9-90f22fafbee8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.166722 Sep 19 12:05:14.665443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 422/876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:15.619662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:15.621860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:15.628119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:15.628652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:15.629099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:15.629864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:15.630273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:15.630700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:15.659872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25303988-7e13-467e-b044-752cc7ae99fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044693 Sep 19 12:05:15.660435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 455/877] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:15.687524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:15.688140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:15.694860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:15.695377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:15.695844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:15.696554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:15.697013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:15.697440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:15.826488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:15.834403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ee55aff-36a5-40b2-a7d4-5512e2d1ef2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150711 Sep 19 12:05:15.835465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 423/878] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:16.672971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:16.675258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:16.682780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:16.683259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:16.683692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:16.684390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:16.684831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:16.685256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:16.716277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7b1b0f5-3381-4841-9945-7b943aae037d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047426 Sep 19 12:05:16.716829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 456/879] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:16.858836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:16.859699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:16.867796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:16.868284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:16.868715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:16.869413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:16.869895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:16.870370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:17.001854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:17.011039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80a57a31-9322-495f-8a41-5115ceb07c78 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156700 Sep 19 12:05:17.011607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 424/880] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:17.728993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:17.731387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:17.737466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:17.737973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:17.738404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:17.739095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:17.739592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:17.739950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:17.769596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8acd772e-eda2-4b2b-944b-c01d27f57d27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044990 Sep 19 12:05:17.770174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 457/881] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:18.034255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:18.034856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:18.041993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:18.042481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:18.042914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:18.043609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:18.044061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:18.044485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:18.177025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:18.184756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b3663ab-751e-4a99-bfe1-4028e38a6f9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154325 Sep 19 12:05:18.185343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 425/882] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:18.782485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:18.784641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:18.791356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:18.791844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:18.792275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:18.792964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:18.793410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:18.793852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:18.823748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a1a0758-9bed-41b7-b2c9-f657507000c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045251 Sep 19 12:05:18.824304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 458/883] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:19.207746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:19.208348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:19.215689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:19.216171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:19.216607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:19.217304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:19.217756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:19.218200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:19.349704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:19.357553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3abeacfc-97c7-4a57-b548-4feead9e52a0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153691 Sep 19 12:05:19.358140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 426/884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:19.836306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:19.838466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:19.844918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:19.845418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:19.845835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:19.846540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:19.846985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:19.847401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:19.879199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c553d3e3-6fdb-4c6e-bb33-2b42a04790b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046836 Sep 19 12:05:19.879759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 459/885] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:20.380416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:20.381015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:20.388202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:20.388690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:20.389115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:20.389831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:20.390285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:20.390707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:20.524543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:20.532291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-52065c27-04bc-4c97-bda2-aea32d33a7d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155848 Sep 19 12:05:20.532850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 427/886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:20.892944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:20.895120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:20.901560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:20.902077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:20.902515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:20.903329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:20.903644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:20.904113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:20.939845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f871a9f6-24e5-46a0-95a9-c458142436b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050709 Sep 19 12:05:20.940793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 460/887] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:21.555581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:21.556188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:21.563324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:21.563825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:21.564266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:21.564966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:21.565425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:21.565889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:21.696891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:21.705799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7f27a12-3365-4e9a-991b-6bdaf368d6d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154051 Sep 19 12:05:21.706378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 428/888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:21.954337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:21.957907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:21.968759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:21.969554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:21.970333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:21.971475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:21.972223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:21.972916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:22.010075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9baaeda-d754-4fe9-a041-08a9f8b1188e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061399 Sep 19 12:05:22.010720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 461/889] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:22.729607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:22.730161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:22.736659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:22.737142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:22.737576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:22.738303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:22.738759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:22.739182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:22.874588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:22.882279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4183a6b2-d022-4fd7-84f4-29b8e88ece05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156620 Sep 19 12:05:22.883419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 429/890] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:23.022957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:23.025292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:23.031708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:23.032204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:23.032639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:23.033335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:23.033816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:23.034245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:23.066052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79e268c0-b7ed-476a-add4-72c9ea21bda9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047432 Sep 19 12:05:23.066607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 462/891] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:23.904931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:23.905555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:23.912178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:23.912709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:23.913194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:23.913923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:23.914382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:23.915305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:24.047643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:24.055808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e192acee-60dc-4216-8b5c-3abac653fdaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154499 Sep 19 12:05:24.056216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 430/892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:24.078401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:24.080544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:24.087386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:24.087872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:24.088318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:24.089020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:24.089804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:24.090239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:24.121724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ec97c81-d873-4d2c-b9d0-4e300380c9d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047228 Sep 19 12:05:24.122317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 463/893] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:25.078271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:25.079589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:25.088512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:25.088512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:25.088764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:25.089809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:25.090210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:25.090660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:25.137795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:25.139932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:25.150194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:25.150681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:25.151111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:25.151816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:25.152245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:25.152834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:25.199452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa697561-599a-4081-a4a5-1ea0a7da0350 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066183 Sep 19 12:05:25.200035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 464/894] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:25.237164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:25.246123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c95cc43-e752-491c-b38e-808bb0b5adf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.171690 Sep 19 12:05:25.246696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 431/895] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:26.214709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:26.216836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:26.223046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:26.223520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:26.223949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:26.224765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:26.225075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:26.225512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:26.256279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-971b1c31-0e74-4c3d-8c93-f7ce14113a4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046814 Sep 19 12:05:26.256825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 465/896] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:26.268440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:26.269000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:26.275340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:26.275819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:26.276248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:26.276933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:26.277382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:26.277824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:26.412274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:26.419933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6d4b5e0-cfba-466c-b0d0-65d804d975df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155274 Sep 19 12:05:26.420495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 432/897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:27.269132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:27.271042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:27.276914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:27.277392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:27.277863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:27.278559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:27.279002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:27.279415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:27.314226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b9e6760-75b5-4659-8083-e74f1320929c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049673 Sep 19 12:05:27.314791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 466/898] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:27.443269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:27.443820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:27.450292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:27.450781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:27.451221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:27.451923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:27.452382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:27.452814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:27.583083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:27.590953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ef11bda-96ae-4435-acf1-d33cdbd29ee6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151692 Sep 19 12:05:27.591516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 433/899] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:28.327708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:28.329909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:28.336220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:28.337283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:28.337716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:28.338440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:28.338893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:28.339340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:28.343344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:28.372830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7614ff1-817a-4f72-b293-bad8939712a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049596 Sep 19 12:05:28.373469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 467/900] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:28.614324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:28.614953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:28.621901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:28.622387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:28.622818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:28.623510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:28.623964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:28.624378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:28.753707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:28.762024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50308029-4ffc-4b08-942e-edd3a388e054 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151682 Sep 19 12:05:28.762592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 434/901] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:29.385617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:29.387884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:29.394283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:29.394761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:29.395194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:29.395906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:29.396343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:29.396806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:29.427635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7ba3a18-19fa-4050-afd8-2de402fdf132 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045970 Sep 19 12:05:29.428200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 468/902] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:29.783879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:29.784498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:29.791194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:29.791685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:29.792123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:29.792823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:29.793281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:29.793710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:29.930106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:29.937760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad5f36e6-b7f5-40d6-905a-02337462d7e7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157760 Sep 19 12:05:29.938345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 435/903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:30.440842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:30.443015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:30.449275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:30.449752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:30.450221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:30.450900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:30.451345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:30.451767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:30.495729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d8c3d74-9c10-4f71-8eac-1f4ac4fc845e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059307 Sep 19 12:05:30.496302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 469/904] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:30.962058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:30.962748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:30.970185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:30.970812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:30.971272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:30.972025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:30.972481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:30.973006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:31.106809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:31.114622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-37dce6e2-48d5-46a9-b240-1c8a82647ed9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156953 Sep 19 12:05:31.115187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 436/905] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:31.509410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:31.511586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:31.517904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:31.518421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:31.518855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:31.519545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:31.519995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:31.520412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:31.551223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4acd3198-8b1e-435f-bf62-7634cb946792 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046709 Sep 19 12:05:31.551805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 470/906] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:32.138584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:32.139202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:32.145643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:32.146231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:32.146732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:32.147469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:32.148334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:32.148436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:32.282618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:32.290981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5383f92d-8fec-4b1d-a467-9e0c83925578 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156230 Sep 19 12:05:32.291548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 437/907] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:32.564776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:32.567209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:32.573554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:32.574065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:32.574496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:32.575185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:32.575632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:32.576046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:32.608746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de5de6b8-e074-4665-9ab9-07a64ac15503 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048097 Sep 19 12:05:32.609312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 471/908] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:33.314797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:33.315334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:33.322375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:33.322864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:33.323303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:33.323998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:33.324456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:33.324884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:33.327510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:33.458796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:33.467621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e0fd6a42-dccf-45e6-863c-f9834a9655ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157066 Sep 19 12:05:33.468245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 438/909] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:33.621905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:33.624268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:33.631409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:33.631900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:33.632334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:33.633088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:33.633648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:33.634112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:33.664185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d80776e7-1384-4684-adf7-8349b01cd5e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046946 Sep 19 12:05:33.665797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 472/910] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:34.490486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:34.491115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:34.497787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:34.498269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:34.498708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:34.499410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:34.499869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:34.500383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:34.639505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:34.647268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3025da70-1f33-4a2e-b58f-46f0fbfdb720 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160599 Sep 19 12:05:34.647832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 439/911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:34 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:34.676519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:34.678605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:34.685069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:34.685811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:34.686222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:34.686918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:34.687365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:34.687778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:34.720693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9c46689-a17e-4163-80f9-510957abce01 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047961 Sep 19 12:05:34.721466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 473/912] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:35.671041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:35.671629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:35.678035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:35.678512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:35.678939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:35.679647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:35.680173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:35.680513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:35.733347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:35.735517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:35.742041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:35.742521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:35.742947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:35.743640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:35.744085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:35.744499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:35.778260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c9051a2-f55c-4a6e-bfa6-1dffdc27cf04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049300 Sep 19 12:05:35.779193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 474/913] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:35.822192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:35.829758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5445e75a-f7c1-4bd3-953f-88acd7a723bb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.163082 Sep 19 12:05:35.830342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 440/914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:36.791148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:36.793347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:36.800192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:36.800686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:36.801166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:36.802588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:36.803055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:36.803529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:36.836852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e84564ce-8380-4088-93f1-70d1713f37e9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049661 Sep 19 12:05:36.842647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 475/915] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:36.858693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:36.858693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:36.865788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:36.865788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:36.865788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:36.866751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:36.867220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:36.867653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:37.003218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:37.012014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7ac58a3a-1cd0-4e1e-98eb-b261385e7713 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.163384 Sep 19 12:05:37.013108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 441/916] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:37.850243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:37.852394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:37.860227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:37.860794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:37.861234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:37.861992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:37.862448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:37.862873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:37.893570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3513cefd-10ad-49bc-9c3b-fa2994ed37e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047305 Sep 19 12:05:37.894175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 476/917] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:38.037419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:38.038192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:38.045282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:38.045790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:38.046221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:38.046918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:38.047367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:38.047853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:38.189587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:38.197279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-35a97c54-f32a-479e-8b65-d7c17b189a49 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.164558 Sep 19 12:05:38.197871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 442/918] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:38.907122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:38.909295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:38.915658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:38.916183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:38.916614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:38.917328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:38.917796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:38.918221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:38.948784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d81bbc8b-4e1b-46dc-ae03-97bf55cd39f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046229 Sep 19 12:05:38.949343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 477/919] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:39.221128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:39.221699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:39.228141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:39.228628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:39.229069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:39.229788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:39.230257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:39.230684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:39.373128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:39.380888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-14b9a2b6-8409-422d-95f6-c9a166412bbe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.163689 Sep 19 12:05:39.381455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 443/920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:39 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:39.961609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:39.963737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:39.970289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:39.970807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:39.971197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:39.971874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:39.972321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:39.972739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:40.002565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af0b6b33-0520-4bcd-b583-8322a81bbc0d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044941 Sep 19 12:05:40.003124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 478/921] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:40.404177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:40.404813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:40.411374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:40.411859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:40.412291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:40.412989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:40.413441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:40.413925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:40.554004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:40.561954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1effb563-19fe-48dd-a458-78533accc0fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162321 Sep 19 12:05:40.562520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 444/922] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:41.015606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:41.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:41.025533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:41.026595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:41.027201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:41.029298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:41.030971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:41.031689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:41.065505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b0c7058-c018-4093-b7dd-57bf2d24f8a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054408 Sep 19 12:05:41.066175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 479/923] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:41.584520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:41.585247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:41.587539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:41.593227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:41.593713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:41.594176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:41.594956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:41.595411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:41.595841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:41.724910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:41.733118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2c5d2d95-c31f-4a76-9e1f-cd5848d88f6d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152501 Sep 19 12:05:41.733676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 445/924] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:42.078442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:42.080596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:42.086957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:42.087435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:42.087867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:42.088556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:42.089006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:42.089426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:42.120283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cb17bdf-f7b7-4fca-ac64-281b95910fa0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046005 Sep 19 12:05:42.120851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 480/925] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:42.756251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:42.756882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:42.764015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:42.764496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:42.765006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:42.765610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:42.766086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:42.766506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:42.896425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:42.904410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a33eb100-ee04-47eb-9614-390516d81b6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151955 Sep 19 12:05:42.904978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 446/926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:43.132274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:43.134587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:43.141328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:43.141806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:43.142250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:43.142975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:43.143431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:43.143856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:43.174295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcf6fd21-4d87-4ee6-88a0-c845a993a011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045916 Sep 19 12:05:43.174871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 481/927] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:43.927552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:43.928103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:43.935188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:43.935676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:43.936116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:43.936816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:43.937276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:43.937709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:44.075465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:44.083217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-453c5e22-d115-4e5f-846b-810596efeba4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159636 Sep 19 12:05:44.083785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 447/928] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:44.187042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:44.189187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:44.191485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:44.196897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:44.197372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:44.197826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:44.198510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:44.198955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:44.199370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:44.229830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0dfb75f-0eae-4975-a759-2657379deb32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046851 Sep 19 12:05:44.230389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 482/929] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:45.107104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:45.108561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:45.115868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:45.116353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:45.116790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:45.117485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:45.118003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:45.118429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:45.242965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:45.245160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:45.249367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:45.251850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:45.252338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:45.252766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:45.253462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:45.253929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:45.254346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:45.257643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d0083df-7bc1-4174-8641-139ad5b75a0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154943 Sep 19 12:05:45.258250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 448/930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:45.284004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:45.289608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c12edbe9-8676-4e03-a9fb-5f1150353579 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050632 Sep 19 12:05:45.290369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 483/931] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:46.302216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:46.304563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:46.311807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:46.312313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:46.312746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:46.313690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:46.313921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:46.314338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:46.348517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b09cb1f-7208-444b-bc2e-a4b4d18734be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050270 Sep 19 12:05:46.354114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 484/932] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:46.356972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:46.357787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:46.364930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:46.365432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:46.365930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:46.366653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:46.367110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:46.367536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:46.514500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:46.522847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-90af739b-1fa7-4797-aa1e-92557e6fdb0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.246068 Sep 19 12:05:46.523431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 449/933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:47.360832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:47.362909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:47.369261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:47.369736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:47.370191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:47.370875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:47.371320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:47.371735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:47.401601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78bb3b86-0d5b-4e80-8ec9-29b4ed597b51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044840 Sep 19 12:05:47.402188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 485/934] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:47.544952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:47.545560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:47.554371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:47.554852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:47.555294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:47.555982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:47.556431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:47.556851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:47.690122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:47.697734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2bbc9ba5-d289-4466-a06f-0b2c2eda3e58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156663 Sep 19 12:05:47.698375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 450/935] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:48.414470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:48.416696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:48.423071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:48.423553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:48.424014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:48.424798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:48.425300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:48.425819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:48.455357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec727578-670b-4755-ade8-31269ab5173d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045025 Sep 19 12:05:48.455909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 486/936] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:48.721105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:48.721685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:48.728016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:48.728503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:48.728938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:48.729629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:48.730113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:48.730539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:48.865682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:48.873340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8120f847-89a0-471c-ac00-f566687114d6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156346 Sep 19 12:05:48.873931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 451/937] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:49.468687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:49.470810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:49.477287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:49.477789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:49.478236 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:49.478927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:49.479407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:49.479830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:49.510525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7fbb4ce-f0ca-4834-99ff-79a0aefeda7b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046206 Sep 19 12:05:49.511086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 487/938] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:49.896405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:49.897018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:49.904001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:49.904491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:49.904925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:49.905616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:49.906098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:49.906520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:50.036264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:50.043890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-23fed1a6-5474-4ed8-837f-3ac06ea76f8a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151414 Sep 19 12:05:50.044450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 452/939] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:50.524979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:50.527140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:50.534698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:50.535240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:50.535679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:50.536367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:50.536824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:50.537241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:50.566832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ea78c1e-3165-4a77-b0a7-6746e1d5bf15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045883 Sep 19 12:05:50.567383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 488/940] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:51.067339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:51.067938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:51.074275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:51.074752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:51.075178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:51.075860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:51.076306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:51.076721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:51.207599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:51.215571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f04ed700-ba3d-4133-bf17-da9965f9f938 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152040 Sep 19 12:05:51.216128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 453/941] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:51.579774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:51.582068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:51.588578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:51.589058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:51.589741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:51.590465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:51.590916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:51.591337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:51.621992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3d6db50-b2be-4631-9cce-165bf49323c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046278 Sep 19 12:05:51.622596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 489/942] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:52.237554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:52.238191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:52.244810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:52.245306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:52.245743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:52.246482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:52.246940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:52.247370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:52.381710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:52.383973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:52.391267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a35c2a2-165b-4b5b-85c5-739295d05f72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157678 Sep 19 12:05:52.391849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 454/943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:52.634716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:52.636852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:52.644190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:52.644674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:52.645106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:52.645828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:52.646284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:52.646708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:52.675801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-778e269c-ea58-4909-bd2a-f7d934ee34e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045124 Sep 19 12:05:52.676352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 490/944] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:53.413968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:53.414676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:53.421597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:53.422102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:53.422538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:53.423229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:53.423680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:53.424102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:53.553183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:53.560816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-199a4c1c-5837-4015-8ebc-722bb461e037 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151057 Sep 19 12:05:53.561385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 455/945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:53.688540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:53.690678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:53.697130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:53.697607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:53.698080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:53.698772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:53.699224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:53.699646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:53.731578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1c6a847-c732-4016-bfac-cc42f5ea9d79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047001 Sep 19 12:05:53.732180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 491/946] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:54.583697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:54.584297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:54.591295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:54.591813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:54.592257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:54.593478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:54.594021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:54.594477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:54.732895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:54.741668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b76d063a-7d85-4c2b-bc7d-9bd275db69b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161816 Sep 19 12:05:54.742321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 456/947] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:54.746129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:54.748578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:54.755788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:54.756281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:54.756719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:54.757432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:54.757924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:54.758355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:54.790711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2c837a2-85f7-4e89-8f6f-33cd01b94b4b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048432 Sep 19 12:05:54.791295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 492/948] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:55.765117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:55.765726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:55.772222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:55.772709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:55.773146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:55.773874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:55.774330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:55.774755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:55.804329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:55.806584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:55.813821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:55.814311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:55.814749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:55.815462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:55.816074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:55.816341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:55.848286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bf702e8-b9ca-406b-bae5-04e26b9a8c18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047929 Sep 19 12:05:55.848866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 493/949] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:05:55.910917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:55.918823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b495f37-931d-46bf-aaf5-00bb6f4277ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158119 Sep 19 12:05:55.919399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 457/950] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:56.861638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:56.865229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:56.872163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:56.872654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:56.873086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:56.874294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:56.874774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:56.875194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:56.906089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd9515b2-b535-4034-93ed-5aaa9729c6d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048920 Sep 19 12:05:56.906643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 494/951] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:56.943289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:56.943903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:56.950664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:56.951147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:56.951581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:56.953061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:56.953518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:56.953984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:57.088902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:57.096961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d681319-3fd3-4862-8c0b-01011876a002 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157458 Sep 19 12:05:57.097571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 458/952] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:57.920100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:57.922926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:57.928747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:57.929225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:57.929717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:57.930372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:57.930820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:57.931239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:57.960363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc6e5168-dc64-4a44-95ab-f8bfd6479511 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045284 Sep 19 12:05:57.960910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 495/953] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:58.119728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:58.120367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:58.126396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:58.126889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:58.127328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:58.128023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:58.128479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:58.128909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:58.259372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:58.267565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-315eaec3-2c2d-4c2b-bbfa-2a6ae38c5fa5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151943 Sep 19 12:05:58.268121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 459/954] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:58.974102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:58.976250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:58.982639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:58.983119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:58.983553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:58.984244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:58.984692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:58.985114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:59.016656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bebe147-1059-44f5-9204-a42a6e6e6c06 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046439 Sep 19 12:05:59.017241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 496/955] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:05:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:05:59.289783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:59.290410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:59.292389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:05:59.292533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:05:59.299368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:59.300139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:59.300309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:59.301025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:59.301478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:59.301954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:59.437045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:59.445479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81b53e33-0a59-4708-9cc3-610bc51a6ad5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159588 Sep 19 12:05:59.446112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 460/956] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:00.031843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:00.033995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:00.040384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:00.040894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:00.041325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:00.042063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:00.042537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:00.042955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:00.072421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43068926-d846-41f4-85d2-56c2ab64fe54 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045363 Sep 19 12:06:00.072977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 497/957] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:00.468418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:00.469671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:00.476136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:00.476571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:00.477008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:00.477711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:00.478253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:00.478691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:00.620440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:00.628708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b11f2a20-71b9-4ef2-a68a-ab368c482c84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.164477 Sep 19 12:06:00.629277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 461/958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:01.084413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:01.086563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:01.093123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:01.093602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:01.094072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:01.094765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:01.095212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:01.095632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:01.125754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a582554-da31-4469-9b1f-867391a9b6e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044722 Sep 19 12:06:01.126336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 498/959] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:01.651472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:01.652099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:01.659213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:01.660768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:01.661214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:01.661958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:01.662439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:01.662865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:01.791953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:01.799632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a42e7b04-af98-4de0-94fb-a840ccbc32dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152029 Sep 19 12:06:01.800205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 462/960] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:02.138551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:02.141347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:02.147824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:02.148687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:02.148793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:02.149414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:02.149893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:02.150321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:02.179544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3889f387-f158-4e0f-9a50-fadffc233d95 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044998 Sep 19 12:06:02.180106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 499/961] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:02.822350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:02.822951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:02.829323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:02.829836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:02.830271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:02.830959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:02.831409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:02.831826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:02.963657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:02.972003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7fc9a58b-6cbb-46fd-b6c2-ef0838af753f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153483 Sep 19 12:06:02.972576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 463/962] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:03.192295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:03.194535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:03.200918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:03.201398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:03.201866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:03.202562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:03.203523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:03.203948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:03.221203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:03.235170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e24217d-3fbe-40db-a4f4-8fc4dbab9f43 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046928 Sep 19 12:06:03.235740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 500/963] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:03.996219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:03.996801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:04.003197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:04.003690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:04.004131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:04.004833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:04.005293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:04.005721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:04.142548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:04.151027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f159e39d-2d8c-4049-ad56-0107a794f34d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158937 Sep 19 12:06:04.151299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 464/964] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:04.248015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:04.250011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:04.256440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:04.256917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:04.257351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:04.258068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:04.258667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:04.258941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:04.288786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ba6baff-dfb2-4556-bc8e-25a55c6802ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044950 Sep 19 12:06:04.289419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 501/965] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:05.174809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:05.175417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:05.181937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:05.182424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:05.182860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:05.183552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:05.184006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:05.184433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:05.301378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:05.303542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:05.309977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:05.310466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:05.310932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:05.311637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:05.312112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:05.312543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:05.314820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:05.322564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8553a854-fd9b-4089-a05a-b66508cf0bfb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152484 Sep 19 12:06:05.323134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 465/966] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:05.344465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f43449ac-f41e-4c3d-9759-e85e67fb4b26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047649 Sep 19 12:06:05.344955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 502/967] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:06.345643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:06.346304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:06.352925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:06.353413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:06.353873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:06.354579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:06.355028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:06.355442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:06.356859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:06.359614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:06.366525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:06.367023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:06.367458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:06.368157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:06.368611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:06.369036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:06.502491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:06.510217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b59596e-0cde-4dd7-8d2c-13cb1089c5d3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.168298 Sep 19 12:06:06.511029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 466/968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:06.555506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba0d6af0-1e0b-4c81-950f-6d8efd2ef59a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.202827 Sep 19 12:06:06.557004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 503/969] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:07.532633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:07.533300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:07.539795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:07.540272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:07.540700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:07.541383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:07.541853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:07.542273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:07.569448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:07.571826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:07.578302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:07.578857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:07.579531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:07.580351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:07.580973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:07.581577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:07.622193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7c7c6fa-5585-4961-8718-06eda81060d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057287 Sep 19 12:06:07.622764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 504/970] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:07.688127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:07.695784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cddfdabf-35b6-48fa-a1fa-c6ad2c94ff21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.167152 Sep 19 12:06:07.696357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 467/971] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:08.635305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:08.637478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:08.643271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:06:08.643454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:06:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments (ip 10.222.0.88) !!! Sep 19 12:06:08.648497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:08.649344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:08.650089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:08.651248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:08.652006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:08.652706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:08.686271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f924da0-a2b0-43d1-9898-b73f2c368a4c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054849 Sep 19 12:06:08.686880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 505/972] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:08.719776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:08.720401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:08.727042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:08.727664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:08.728096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:08.728905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:08.729461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:08.730038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:08.863779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:08.871929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29dc9fc7-1ab5-40af-8d61-ff360c77df48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156623 Sep 19 12:06:08.872561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 468/973] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:09.697846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:09.700082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:09.706547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:09.707034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:09.707467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:09.708168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:09.708619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:09.709038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:09.741916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb31aeb7-a57e-40c4-969c-d0cbcda3c96d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047975 Sep 19 12:06:09.746892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 506/974] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:09.895870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:09.896474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:09.898474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:06:09.898597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:06:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:06:09.904934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:09.905414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:09.905866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:09.907084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:09.907551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:09.907970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:10.044400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:10.052317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f586810-9a5a-4df5-9003-d20338f7b8d2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160243 Sep 19 12:06:10.052879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 469/975] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:10.755644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:10.757806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:10.764709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:10.765190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:10.765623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:10.766401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:10.766859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:10.767283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:10.796595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b6ca89c-4ac2-4d73-bac6-104d28282586 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045939 Sep 19 12:06:10.797855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 507/976] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:11.074210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:11.075080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:11.082622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:11.083116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:11.083556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:11.084255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:11.084718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:11.085153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:11.219889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:11.227650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d35f08fa-b20b-40a3-bd20-b46db3fb9a18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157478 Sep 19 12:06:11.228273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 470/977] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:11.809062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:11.811253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:11.817959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:11.818376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:11.818813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:11.819513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:11.821289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:11.821289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:11.850992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c32ea5c6-722b-4ff7-b4c0-1b3950b81e96 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046101 Sep 19 12:06:11.851562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 508/978] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:12.250317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:12.250922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:12.253255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:12.258398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:12.258913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:12.259344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:12.260085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:12.260530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:12.260948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:12.278763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:12.397419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:12.405435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db1ccbd0-39c8-4fa0-8cc4-f619573f201e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158913 Sep 19 12:06:12.406035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 471/979] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:12.864317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:12.866531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:12.873493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:12.873601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:12.873985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:12.874687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:12.875643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:12.876066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:12.907654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed1ca958-7cdd-4760-9261-584a23ab9924 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047765 Sep 19 12:06:12.908210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 509/980] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:13.429038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:13.429607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:13.435990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:13.436872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:13.437479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:13.438224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:13.438674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:13.439092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:13.569677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:13.577400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ea21557-aded-4d2d-b85c-0a5e4ee900ee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152276 Sep 19 12:06:13.577994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 472/981] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:13.920257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:13.922422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:13.928732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:13.929265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:13.929674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:13.931508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:13.932023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:13.932451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:13.962304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40a0016f-6a59-41d1-8e49-651fb24204b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045950 Sep 19 12:06:13.962854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 510/982] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:14.600811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:14.601361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:14.607776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:14.608262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:14.608699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:14.609899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:14.610370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:14.610798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:14.751034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:14.758764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee088937-02fe-469b-9ebc-427e73772b37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162086 Sep 19 12:06:14.759344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 473/983] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:14.976596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:14.979065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:14.981708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:14.987480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:14.987959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:14.988385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:14.989101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:14.989541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:14.989979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:15.019571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef4a0674-7ba9-46e6-b12f-dbe1b73f73cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047516 Sep 19 12:06:15.020432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 511/984] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:15.781587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:15.782227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:15.788627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:15.789123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:15.789565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:15.790295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:15.790753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:15.791180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:15.922641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:15.930377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-25f41e34-7093-4b5d-aaa0-29ee250f8709 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152814 Sep 19 12:06:15.930943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 474/985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:06:16.032857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:16.035048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:16.041721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:16.042233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:16.042662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:16.043353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:16.043804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:16.044219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:16.078419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9664da0b-9f34-403a-b718-6dd50a4df7b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049626 Sep 19 12:06:16.079107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 512/986] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:16.953996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:16.954624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:16.961321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:16.961843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:16.962302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:16.963001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:16.963455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:16.963880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:17.092234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:17.094482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:17.099148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:17.100815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:17.101301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:17.101731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:17.102456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:17.102903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:17.103322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:17.107409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0177c452-3675-4329-be06-b239f8a8ec71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157741 Sep 19 12:06:17.107996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 475/987] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:17.139201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f4db7d2-d89b-4d9e-8db7-8dc276fd9a7a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051373 Sep 19 12:06:17.139773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 513/988] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:18.130465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:18.131074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:18.137646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:18.138161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:18.138602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:18.139303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:18.139853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:18.140283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:18.153515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:18.155640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:18.162408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:18.162886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:18.163313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:18.163993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:18.164433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:18.164847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:18.195342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26b3898c-9340-486a-ae43-70f84da9f7ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046195 Sep 19 12:06:18.195874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 514/989] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:18.278269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:18.286582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e347bb0-3e38-4284-ad02-e6bf60832fff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160154 Sep 19 12:06:18.287139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 476/990] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:19.207432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:19.209670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:19.216331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:19.216806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:19.217234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:19.217952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:19.218399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:19.218872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:19.248079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-591e6e46-7b5d-4aa1-b177-9e9426856d15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045212 Sep 19 12:06:19.248946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 515/991] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:19.309067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:19.309717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:19.316226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:19.316721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:19.317163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:19.317896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:19.318357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:19.318795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:19.457159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:19.465030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f8da996d-108e-4aa4-be7c-edf45c49f1bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160299 Sep 19 12:06:19.465806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 477/992] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:20.261615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:20.263755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:20.270684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:20.271169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:20.271606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:20.272297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:20.272782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:20.273263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:20.301929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dbc0a26a-816b-48ed-9674-283d16e85ee0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044325 Sep 19 12:06:20.302465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 516/993] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:20.488694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:20.489304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:20.496331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:20.496892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:20.497328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:20.498118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:20.498588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:20.499027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:20.633594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:20.641369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1bf080a0-9241-4d58-bece-0ba4dbfb4d50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157072 Sep 19 12:06:20.641966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 478/994] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:21.314629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:21.316785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:21.323249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:21.323736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:21.324170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:21.324859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:21.325307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:21.325727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:21.329837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:21.356080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b89240c5-ff3e-4282-b2e9-a25d8477e0f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045441 Sep 19 12:06:21.356639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 517/995] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:21.663994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:21.664540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:21.670925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:21.671403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:21.671838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:21.672568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:21.673035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:21.673460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:21.805620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:21.815445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fce05080-6e35-42ed-a5af-1aeaf5b612b6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155321 Sep 19 12:06:21.816027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 479/996] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:22.369051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:22.371237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:22.377602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:22.378122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:22.378563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:22.379288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:22.379741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:22.380342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:22.414686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4969c90-61c5-463d-a903-a859c10d931f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049630 Sep 19 12:06:22.415168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 518/997] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:22.842387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:22.843003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:22.850104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:22.850597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:22.851040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:22.851733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:22.852191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:22.852618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:22.984880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:22.992490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c85057b-8afd-4408-a29d-d078f2f1b744 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154313 Sep 19 12:06:22.993049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 480/998] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:23.427103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:23.429149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:23.435534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:23.436016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:23.436456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:23.437151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:23.438271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:23.438698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:23.467614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c0eb0be-6b78-42fc-9c8c-0653dd0d219d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044583 Sep 19 12:06:23.468155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 519/999] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:24.015237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:24.015851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:24.022353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:24.022844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:24.023276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:24.024019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:24.024495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:24.025060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:24.163010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:24.170794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85a1e533-6b33-4092-9527-e38baaacac4a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159560 Sep 19 12:06:24.171365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 481/1000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:24.480555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:24.482627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:24.489025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:24.489512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:24.490350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:24.490694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:24.491171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:24.491592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:24.522245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1c2557f-81c1-42d8-8447-a3fae277e258 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045710 Sep 19 12:06:24.523020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 520/1001] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:25.194574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:25.195176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:25.201521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:25.202042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:25.202468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:25.203324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:25.203782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:25.204195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:25.338184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:25.346507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7e2d0f5-431f-46f0-b462-c58e46aed19a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155857 Sep 19 12:06:25.347061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 482/1002] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:25.535420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:25.537595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:25.544198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:25.544679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:25.545110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:25.545817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:25.546266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:25.547317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:25.577418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6dc4c12-7cc0-4d91-8626-21d64f57eb28 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046566 Sep 19 12:06:25.578040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 521/1003] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:26.369711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:26.370348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:26.377181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:26.377660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:26.378118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:26.378808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:26.379259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:26.379677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:26.511903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:26.519667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a510891-5340-43ef-86d9-0fa3ce0adddb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153791 Sep 19 12:06:26.520225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 483/1004] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:26.590635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:26.592777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:26.599101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:26.599580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:26.600043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:26.600732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:26.601210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:26.601697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:26.632846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f294aef4-6ec8-487c-b2b1-7aa84acc7d26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046432 Sep 19 12:06:26.633415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 522/1005] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:27.542543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:27.543203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:27.549739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:27.550265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:27.550701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:27.551407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:27.551865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:27.552293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:27.645180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:27.647393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:27.654194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:27.654689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:27.655118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:27.655874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:27.656323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:27.656749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:27.684311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:27.686945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcb333b0-5b24-4209-b8f4-f8f3cbeeac5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046262 Sep 19 12:06:27.688000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 523/1006] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:27.692458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad34f20d-b4cc-43fc-a99e-a803c4d64815 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153818 Sep 19 12:06:27.693023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 484/1007] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:28.700258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:28.702457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:28.708844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:28.709325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:28.709782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:28.710487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:28.710934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:28.711350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:28.715646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:28.716338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:28.722768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:28.723262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:28.723725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:28.724434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:28.724889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:28.725311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:28.747846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e629bae-393c-4a55-afdb-cc8a47c96c52 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051595 Sep 19 12:06:28.748396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 524/1008] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:28.864955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:28.872819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fba8d07c-a8fd-47ad-99f0-ce10a297fb1b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161429 Sep 19 12:06:28.873380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 485/1009] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:06:29.761333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:29.763523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:29.769879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:29.770359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:29.770791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:29.771479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:29.771927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:29.772349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:29.802679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8287e68-01b7-4d24-8ac5-168917018fe8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045273 Sep 19 12:06:29.803238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 525/1010] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:29.896308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:29.896872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:29.900269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:06:29.900449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:06:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:06:29.912273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:29.913111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:29.913616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:29.914549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:29.915011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:29.915445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:30.045377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:30.053981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f768f9bf-5845-4d83-aaa8-3de23023c547 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.161411 Sep 19 12:06:30.054433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 486/1011] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:30.816108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:30.818533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:30.825397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:30.825916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:30.826355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:30.827055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:30.827505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:30.828567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:30.857700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9f019d6-7412-44b0-a1c5-30a73c13646a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046649 Sep 19 12:06:30.858276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 526/1012] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:31.076441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:31.076988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:31.083874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:31.084362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:31.084802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:31.085503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:31.085999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:31.086428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:31.236170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:31.244068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-37cbb346-6ad1-444c-abaf-ddf96a0b00b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.171435 Sep 19 12:06:31.244567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 487/1013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:31.870287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:31.872516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:31.879614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:31.880094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:31.880557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:31.881245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:31.881695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:31.882230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:31.911895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-380bfecb-8b7f-42bc-8a65-5dfaaca406a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045569 Sep 19 12:06:31.912442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 527/1014] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:32.267245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:32.267841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:32.274703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:32.275191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:32.275634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:32.276332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:32.276793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:32.277219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:32.279814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:32.423368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:32.431005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd84fa81-b315-4e97-adca-6c16fc803f5f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.167795 Sep 19 12:06:32.431568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 488/1015] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:32.924794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:32.926940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:32.933124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:32.933598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:32.934062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:32.934742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:32.935185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:32.935600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:32.965398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bad1b73a-6792-4f33-a07c-edb9032d9968 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044765 Sep 19 12:06:32.965963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 528/1016] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:33.452369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:33.452963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:33.459453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:33.459937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:33.460378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:33.461076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:33.461535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:33.462002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:33.591438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:33.599763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b15b2315-219c-443a-b318-cdcde26cface tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151267 Sep 19 12:06:33.600373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 489/1017] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:33.978434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:33.980716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:33.987437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:33.987910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:33.988359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:33.989044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:33.989484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:33.989944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:34.019944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8a28b99-245e-4df8-8cee-0aa7013017fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045514 Sep 19 12:06:34.020373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 529/1018] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:34.623838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:34.625072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:34.631775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:34.632333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:34.632772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:34.633478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:34.633983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:34.634412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:34.772489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:34.780162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-01b1b76e-ff90-4310-a839-7ef5aea42daf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160485 Sep 19 12:06:34.780725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 490/1019] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:34 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:35.033452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:35.035637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:35.042059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:35.042539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:35.042969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:35.043647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:35.044093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:35.044507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:35.073417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4288e808-6037-468b-b26d-145c67b90e99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044558 Sep 19 12:06:35.073984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 530/1020] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:35.803606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:35.804218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:35.810628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:35.811109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:35.811542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:35.812231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:35.812686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:35.813109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:35.945115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:35.952849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-031b6fae-e9a5-4274-9263-6da66a76364a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153134 Sep 19 12:06:35.953411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 491/1021] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:36.087550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:36.089897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:36.096825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:36.097293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:36.097719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:36.098418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:36.098868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:36.099281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:36.128498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70f41575-dc56-4fc6-9c1c-7a3909458011 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044943 Sep 19 12:06:36.129049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 531/1022] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:36.976622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:36.977177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:36.983650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:36.984128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:36.984563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:36.985257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:36.985715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:36.986184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:37.117857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:37.126004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-635a7878-66e7-4f1e-ba4f-0b7fe5cd6ae4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152817 Sep 19 12:06:37.126569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 492/1023] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:37.140701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:37.143965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:37.150482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:37.150968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:37.151403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:37.152103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:37.152558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:37.152981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:37.181727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d24129b-5e77-448b-a73a-4b4439ae7e92 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045127 Sep 19 12:06:37.182310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 532/1024] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:38.148493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:38.149107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:38.155952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:38.156437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:38.157470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:38.158205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:38.158717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:38.159144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:38.194582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:38.197178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:38.204051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:38.204556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:38.204999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:38.205710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:38.206192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:38.206618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:38.236882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:38.242489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65433ad2-2cb9-408b-b5cd-8ae74183c026 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052032 Sep 19 12:06:38.243074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 533/1025] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:38.291279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:38.299051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6e4d83b5-e597-47f8-9e64-ae6091a77129 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.154437 Sep 19 12:06:38.299624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 493/1026] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:39.255659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:39.257805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:39.264319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:39.264804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:39.265239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:39.266628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:39.267087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:39.267518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:39.296291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26d003ca-c463-4607-9361-f1c97637cc40 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044429 Sep 19 12:06:39.296846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 534/1027] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:39.320922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:39.321532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:39.328051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:39.329229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:39.329674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:39.330392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:39.330844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:39.331271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:39.465866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:39.473598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-be70a9aa-5694-46f5-b1eb-dbb8ab9e8668 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156593 Sep 19 12:06:39.474199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 494/1028] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:39 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:40.309062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:40.311261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:40.318196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:40.318685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:40.319122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:40.319815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:40.320266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:40.320689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:40.349681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf89da78-b8c7-41db-9cc0-01efb58454ab tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044619 Sep 19 12:06:40.350304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 535/1029] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:40.496268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:40.497187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:40.505155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:40.505656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:40.506132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:40.507535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:40.507922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:40.508342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:40.643332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:40.651090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd819640-747a-4753-85f3-c44b6ff8c155 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158785 Sep 19 12:06:40.651662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 495/1030] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:41.362697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:41.364851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:41.371293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:41.371779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:41.372213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:41.372910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:41.373361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:41.373819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:41.403455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bf6957f-9c1f-498a-bc32-50b5ed330f90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044781 Sep 19 12:06:41.403932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 536/1031] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:41.673935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:41.674459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:41.680901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:41.681391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:41.681859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:41.682562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:41.683021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:41.683452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:41.813364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:41.821045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e211c3a8-76b0-4c59-b996-a3f5ea48b3a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.151117 Sep 19 12:06:41.821612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 496/1032] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:42.416809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:42.418886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:42.425177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:42.425650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:42.426118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:42.426804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:42.427245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:42.427660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:42.457199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adeda173-593e-4614-9d70-2e3f8702f925 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044498 Sep 19 12:06:42.457741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 537/1033] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:42.843871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:42.844482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:42.846835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:42.852153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:42.852641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:42.853072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:42.853791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:42.854251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:42.854675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:42.994252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:43.002602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36f77fc7-be52-4e03-b1d3-374b00e3f4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.162932 Sep 19 12:06:43.003179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 497/1034] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:43.470845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:43.472928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:43.479336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:43.479812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:43.480241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:43.480926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:43.481377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:43.481885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:43.511675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-800133e6-ce7f-4cc4-8ca6-ac34c70157cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045356 Sep 19 12:06:43.512228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 538/1035] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:44.026339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:44.026949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:44.034036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:44.034525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:44.034957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:44.035677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:44.036105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:44.036526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:44.165341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:44.172960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b566ad5d-a78d-4b3b-822c-460c775b9440 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.150580 Sep 19 12:06:44.173513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 498/1036] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:44.524512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:44.526724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:44.533223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:44.533706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:44.534279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:44.534867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:44.535322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:44.535744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:44.565092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b0641e8-06d9-48e5-8349-95d83e1b0614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044561 Sep 19 12:06:44.565658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 539/1037] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:45.195153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:45.195680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:45.202586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:45.203071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:45.203505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:45.204229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:45.204678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:45.205099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:45.343745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:45.351950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d11f57f1-9eb5-45cd-a924-a44f7efaa098 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160830 Sep 19 12:06:45.352519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 499/1038] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:45.577953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:45.580679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:45.582965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:45.588393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:45.589182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:45.589912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:45.590612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:45.591065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:45.591490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:45.621959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f45cfcf-b5d7-4f0a-a689-041460b69bad tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047969 Sep 19 12:06:45.622526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 540/1039] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:46.376123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:46.376735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:46.384390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:46.384891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:46.385356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:46.386102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:46.386563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:46.386991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:46.515543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:46.523439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-064509c9-376b-4cb1-a366-1ce453043e7f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.152273 Sep 19 12:06:46.524015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 500/1040] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:46.634956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:46.637043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:46.643903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:46.644393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:46.644834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:46.645579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:46.646033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:46.646459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:46.687307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c64b56c5-0f73-4388-9e25-66de6cdfdcfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056360 Sep 19 12:06:46.687891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 541/1041] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:47.546543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:47.547213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:47.553655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:47.554159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:47.554585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:47.555270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:47.555719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:47.556135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:47.691067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:47.699241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ede16c08-4f9d-47b6-b3d5-f86e4016c704 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156722 Sep 19 12:06:47.699810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 501/1042] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:47.700109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:47.702260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:47.709137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:47.709612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:47.710103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:47.710776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:47.711225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:47.711638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:47.741029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b1dd444-3656-4552-aaf5-be7c4c43e15e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044918 Sep 19 12:06:47.741579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 542/1043] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:48.724534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:48.725161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:48.731841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:48.732323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:48.732757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:48.733449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:48.733937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:48.734875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:48.753199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:48.755431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:48.761699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:48.762238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:48.762675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:48.763376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:48.763828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:48.764250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:48.794078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac37ef61-aa82-4a01-96fc-1d238a39d894 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045399 Sep 19 12:06:48.794655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 543/1044] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:48.871083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:48.879993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4acd4118-edbf-4506-a2ab-a57c0fbf30b1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159316 Sep 19 12:06:48.880552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 502/1045] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:49.807560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:49.809703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:49.816570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:49.817047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:49.817472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:49.818193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:49.818660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:49.819059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:49.849418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53bee11c-81b0-4a8e-9a07-93b3755ce4d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045904 Sep 19 12:06:49.850019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 544/1046] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:49.902503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:49.903113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:49.909633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:49.910154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:49.910589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:49.911309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:49.911760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:49.912183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:50.042408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:50.051670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-14fe42c9-b361-441e-91f0-f1e6de9da84e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.153090 Sep 19 12:06:50.052241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 503/1047] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:50.863133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:50.865302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:50.871799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:50.872274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:50.872706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:50.873388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:50.873857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:50.874277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:50.903397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5378c2bb-e23f-49b6-88ef-f611477ae02a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044294 Sep 19 12:06:50.903936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 545/1048] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:51.074761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:51.075422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:51.082371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:51.082819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:51.083253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:51.083959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:51.084415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:51.084840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:51.221791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:51.224012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:51.231296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfda3e7e-d3ad-4bc9-8fb0-05a4ce3d1412 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160511 Sep 19 12:06:51.231906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 504/1049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:51.916760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:51.918941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:51.925302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:51.925805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:51.926251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:51.926936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:51.927382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:51.927800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:51.957322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63721979-e9f0-49b7-9e36-91a50f53d2c6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044665 Sep 19 12:06:51.957881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 546/1050] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:52.256111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:52.256747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:52.263492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:52.264000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:52.264439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:52.265134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:52.265590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:52.266039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:52.399272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:52.406975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3549e98f-724b-4a63-b463-3987f4926fc1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.155691 Sep 19 12:06:52.407540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 505/1051] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:52.971097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:52.973239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:52.979958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:52.980479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:52.980932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:52.981756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:52.982262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:52.982681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:53.012166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ddc6b57-1524-4933-8a09-ee16b28543cd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045552 Sep 19 12:06:53.012712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 547/1052] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:53.429626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:53.430503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:53.437008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:53.437495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:53.437965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:53.439176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:53.439674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:53.440119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:53.574200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:53.582804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a6fe9c6-1c29-4a32-9e53-b8263c6a8231 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157147 Sep 19 12:06:53.583399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 506/1053] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:54.025545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:54.027762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:54.037109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:54.038052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:54.040023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:54.040023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:54.040023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:54.040594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:54.082897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29225d4c-64c4-4b71-b6ab-3da4c4ad3dbe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061481 Sep 19 12:06:54.083481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 548/1054] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:54.606121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:54.606717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:54.613224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:54.613706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:54.614169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:54.614860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:54.615345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:54.615759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:54.753118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:54.761203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8a12326-dc4e-4d2c-b279-847b6a457c5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159314 Sep 19 12:06:54.761793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 507/1055] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:55.095518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:55.097714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:55.103962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:55.104433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:55.104857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:55.105539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:55.106005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:55.106423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:55.135917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4055e2eb-44c1-485d-8e89-3e043c076e6e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044415 Sep 19 12:06:55.136474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 549/1056] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:55.785415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:55.786029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:55.792601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:55.793088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:55.793524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:55.794288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:55.794780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:55.795210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:55.932682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:55.940601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-565dec83-0caa-4aae-b058-e6a1088171ac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.159527 Sep 19 12:06:55.941218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 508/1057] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:56.149327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:56.151293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:56.157662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:56.158168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:56.158598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:56.159294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:56.159737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:56.160194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:56.177344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:06:56.191124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04a35f73-1c5b-4719-a674-9b9a94029aa7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046650 Sep 19 12:06:56.191664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 550/1058] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:56.962975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:56.963524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:56.970225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:56.970741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:56.971187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:56.971885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:56.972346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:56.972771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:57.106820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:57.115229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-73f8a061-59de-4428-8b5b-7521820c57c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156261 Sep 19 12:06:57.115792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 509/1059] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:57.204225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:57.206376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:57.212750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:57.213273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:57.213644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:57.214355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:57.215045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:57.215456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:57.245542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5aedc7f3-82b0-4c4d-b7a7-976ae1025446 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045378 Sep 19 12:06:57.246127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 551/1060] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:58.137663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:58.138347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:58.145212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:58.145707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:58.146172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:58.146877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:58.147336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:58.147769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:58.258780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:58.261121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:58.267590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:58.268070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:58.268511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:58.269233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:58.269733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:58.270182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:58.282241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:58.290102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a363e029-3f09-4af0-9303-a1c16f916c0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.156209 Sep 19 12:06:58.302172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 510/1061] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:06:58.302362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b96ee8e3-b4f9-44dd-95fd-5df0f0cf3107 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046714 Sep 19 12:06:58.302362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 552/1062] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:06:59.313294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:59.313862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:06:59.314255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:59.315582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:06:59.321065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:59.322193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:59.322598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:59.322731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:59.323089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:59.323380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:59.323524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:59.323763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:59.324179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:59.324296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:06:59.324662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:06:59.325089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:06:59.363953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c72dfa1-0d50-46b6-bbf8-a1aa90b74856 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054592 Sep 19 12:06:59.364548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 511/1063] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:06:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:06:59.470118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:06:59.477984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af90b5f1-b2da-4819-905b-75a141e907a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.168087 Sep 19 12:06:59.478538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 553/1064] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:06:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:00.376759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:00.379572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:00.386370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:00.386850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:00.387279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:00.387973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:00.388417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:00.388837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:00.418459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9df51564-38ba-4cb9-b955-f31e21604a18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045593 Sep 19 12:07:00.418932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 512/1065] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:00.500802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:00.501400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:00.508746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:00.509235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:00.509658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:00.510391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:00.510849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:00.511261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:00.647336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:00.654991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b84353ae-821a-40d4-9a52-6ed880920648 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158209 Sep 19 12:07:00.655556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 554/1066] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:01.430397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:01.432618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:01.439063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:01.439543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:01.439978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:01.440666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:01.441116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:01.441533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:01.471902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-462b7381-1363-4d16-b328-c505355a1c51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045463 Sep 19 12:07:01.473112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 513/1067] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:01.678003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:01.678662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:01.685045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:01.685530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:01.686039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:01.686742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:01.687224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:01.687669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:01.838029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:01.846407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37feef39-a19f-4e43-917e-8f2429657eea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.172524 Sep 19 12:07:01.846966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 555/1068] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:02.485633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:02.487888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:02.496152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:02.496670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:02.497304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:02.498210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:02.498672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:02.499106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:02.531445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a2a3baca-3b87-4667-997c-4d2815507dd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049856 Sep 19 12:07:02.532001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 514/1069] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:02.869782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:02.870396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:02.876854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:02.877336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:02.877784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:02.878499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:02.878971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:02.879390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:03.013459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:03.022761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4d78459-55b7-450a-ad17-89a2fee1b08a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.157349 Sep 19 12:07:03.023345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 556/1070] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:03.544681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:03.546852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:03.553208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:03.553699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:03.554173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:03.554881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:03.555335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:03.555763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:03.585431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9ff1268-6d4f-46d8-970e-8f2178b3b168 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044763 Sep 19 12:07:03.586055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 515/1071] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:04.046519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:04.047150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:04.053692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:04.054147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:04.054593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:04.055269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:04.055722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:04.056146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:04.195553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:04.203267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d40a886-98a7-4a6c-845d-cf6c481e36b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.160607 Sep 19 12:07:04.203826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 557/1072] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:04.599026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:04.601188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:04.607684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:04.608175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:04.608615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:04.609317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:04.609798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:04.610220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:04.641205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3dfe2fc-23d7-4d31-84c7-f33c63056d2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046655 Sep 19 12:07:04.641795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 516/1073] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:05.226667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:05.227277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:05.233731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.234248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.234683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.235407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.235861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.236286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.371887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:05.380597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-106b151d-2a8b-4254-bdce-cce0a100c5c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1278 microversion: 2.1 time: 0.158373 Sep 19 12:07:05.381224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 558/1074] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:05.403777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:05.404227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:05.410279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.410799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.411239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.411949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.412405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.412827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.437148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:07:05.516589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6537700-d18e-4dff-9f7e-39d10a807ec6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 204 len: 0 microversion: 2.1 time: 0.116616 Sep 19 12:07:05.517384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 517/1075] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:07:05 2022] DELETE /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:07:05.527167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:05.527791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:05.533672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.534188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.534622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.535307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.535763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.536177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.654565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:05.656766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:05.663389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.664142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.664897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.666057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:05.666819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:05.667526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:05.676836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:05.685164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04c1baa6-b6b7-4758-8bbb-8597b26d8e3b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.161927 Sep 19 12:07:05.685613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 559/1076] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:05.701423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c34316ff-dc8e-48b5-8cb5-d6ebd29969ec tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051299 Sep 19 12:07:05.702021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 518/1077] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:06.709981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:06.710690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:06.714826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:06.717011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:06.717446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:06.717594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:06.717989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:06.718687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:06.719133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:06.719552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:06.723410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:06.723897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:06.724993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:06.725840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:06.726152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:06.726575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:06.751737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:06.757784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ade8ce03-a2ba-4ed9-8c92-8a1642bd9774 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047220 Sep 19 12:07:06.758367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 519/1078] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:06.854247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:06.861834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9daf03aa-9505-49c6-a762-da32f93d1072 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156261 Sep 19 12:07:06.862405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 560/1079] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:07.771151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:07.773630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:07.782380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:07.782869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:07.783523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:07.784013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:07.784466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:07.784890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:07.817992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8fb41622-aa0b-4a11-aeb5-ad4d46c82ed6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051003 Sep 19 12:07:07.818551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 520/1080] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:07.885857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:07.886588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:07.893239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:07.893719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:07.894179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:07.894873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:07.895320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:07.895740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:08.035981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:08.045192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31ccfdb6-0ebd-45b5-abae-99fea9b9ca4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.163128 Sep 19 12:07:08.045676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 561/1081] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:08.830049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:08.832195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:08.839190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:08.839935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:08.840365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:08.841060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:08.841509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:08.841963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:08.873182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-603604aa-8dc1-4859-bc84-5917bc57e5ef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047173 Sep 19 12:07:08.873757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 521/1082] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:09.067442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:09.068559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:09.076001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:09.076484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:09.076913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:09.077599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:09.078077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:09.078496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:09.210106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:09.212291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:09.218448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:09.218951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:09.219391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:09.220093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:09.220569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:09.220986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:09.225178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:09.232914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c5bc41c-dc0f-4e67-8788-9d62f034a654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.169333 Sep 19 12:07:09.233698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 562/1083] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:09.251533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9361c165-c53f-4268-9606-1dca1c1e4076 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Sep 19 12:07:09.252145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 522/1084] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:09.886624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:09.888817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:09.894729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:09.895211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:09.895644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:09.896338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:09.896784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:09.897202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:09.926367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b21825cc-7e82-489a-8042-35b88c3f76d8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Sep 19 12:07:09.926918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 563/1085] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:10.185268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:10.185821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:10.192261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.192815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.193248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.193979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.194437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.194866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.255883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:10.256480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:10.263376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.264098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.264528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.265218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.265659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.266109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.278894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lazy-loading 'services' on Instance uuid 6e8311d2-58be-42df-b177-55a98bebcb2e {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:07:10.355564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb322f1d-d3f8-4cb7-a708-d2ea8de63b86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e/os-volume_attachments/40065670-bf02-49b9-b40c-9ab869fa1c4a" status: 202 len: 0 microversion: 2.1 time: 0.173971 Sep 19 12:07:10.356278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 523/1086] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:07:10 2022] DELETE /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e/os-volume_attachments/40065670-bf02-49b9-b40c-9ab869fa1c4a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:07:10.372761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:10.375091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:10.389876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.390398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.390855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.391575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.392050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.392446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.448165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4eada1bf-745d-4702-af79-a9ae9ff68f6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090588 Sep 19 12:07:10.449043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:10.450657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 524/1087] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:10.464096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9aec4e48-08c8-477c-97dc-c5ba05d3fbea tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.211897 Sep 19 12:07:10.467312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 564/1088] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:10.519294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:10.519782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:10.526808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.527704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.528259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.529071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.529416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.529894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.554602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:07:10.634583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-acd9bc55-d865-4f44-b594-73ffb50f0603 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "DELETE /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 204 len: 0 microversion: 2.1 time: 0.118790 Sep 19 12:07:10.635463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 525/1089] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:07:10 2022] DELETE /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:07:10.643889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:10.644495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:10.650973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.651506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.651881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.652569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.653262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.654003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.782823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:10.791038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9f35490-5b9c-403f-803b-0fdc49ad1880 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150946 Sep 19 12:07:10.791614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 565/1090] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:10 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:10.940653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:10.943502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:10.949482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.950017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.950458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.951161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:10.951615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:10.952050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:10.981572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36d66d96-fc68-4b35-855f-760579ee547b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045354 Sep 19 12:07:10.982157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 526/1091] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:11.462973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:11.465392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:11.472387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:11.472862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:11.473290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:11.474783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:11.475527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:11.475968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:11.492252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:11.492781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:11.499484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:11.499967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:11.500435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:11.501194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:11.501589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:11.502042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:11.507366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f4da396-ef9b-4a68-afe6-eaccea56131c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048352 Sep 19 12:07:11.507926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 566/1092] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:11.639058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:11.647296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79adcde3-6e5f-4031-a45b-62578bfa3c11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159512 Sep 19 12:07:11.647859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 527/1093] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:11.814912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:11.815526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:11.821505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:11.822025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:11.822467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:11.823159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:11.823614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:11.824038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:11.828051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:11.961315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:11.969850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9cb7ca8-17b2-46a5-bc4a-657c06f556bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158762 Sep 19 12:07:11.970421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 567/1094] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:11 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:11.994102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:11.996286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:12.002226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:12.002713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:12.003151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:12.003847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:12.004299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:12.004723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:12.034758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59e5fbfe-41e8-42fa-abe1-f2378819e614 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044600 Sep 19 12:07:12.035320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 528/1095] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:12.521853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:12.524510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:12.531283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:12.531771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:12.532202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:12.532901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:12.533351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:12.533833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:12.565059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-552988dc-5f78-4245-a508-fd60238d38e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049025 Sep 19 12:07:12.565611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 568/1096] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:12.671912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:12.672535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:12.679926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:12.680416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:12.680858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:12.681565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:12.682060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:12.682490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:12.818305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:12.826577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a03741ed-7678-4d91-846c-d96bd10d3e53 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158566 Sep 19 12:07:12.827129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 529/1097] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:12.993235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:12.993860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:12.999827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.000304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.000718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.001408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.001877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.002298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.048062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:13.050326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:13.052920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:13.058850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.059407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.059845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.060544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.060995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.061536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.094109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dbd1abf5-57a9-4519-942c-45c835fa8404 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050278 Sep 19 12:07:13.094714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 530/1098] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:13.345102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:13.354057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-636039dc-df4d-4ad5-8d10-f5a95dcb8dbf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.365310 Sep 19 12:07:13.354637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 569/1099] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:12 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:13.577255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:13.579731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:13.587685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.588424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.589095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.590641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.590641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.591082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.622820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d47a4d4a-37da-4745-b717-85cfefcd3368 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049459 Sep 19 12:07:13.623562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 531/1100] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:13.852418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:13.852942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:13.859367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.859844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.860272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.860955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.861396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.861829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.001021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:14.009259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64c6090d-74a3-4fa2-9009-7247863e42af tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160922 Sep 19 12:07:14.009835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 570/1101] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:14.107575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:14.109634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:14.116579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:14.117060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:14.117496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.118215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:14.118666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:14.119088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.149447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a47ed22-01a4-4709-8222-683fa9648c7f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046031 Sep 19 12:07:14.150059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 532/1102] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:14.377689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:14.378225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:14.384148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:14.384625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:14.385049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.385736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:14.386215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:14.386631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.516189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:14.524517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-028c2d17-9615-45ca-bd23-87ae5eb3abdf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150973 Sep 19 12:07:14.525070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 571/1103] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:14 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:14.635016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:14.637189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:14.643155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:14.643648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:14.644091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.644804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:14.645263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:14.646219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.676679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71986e61-6baa-4338-b59e-b47351cc1b56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045653 Sep 19 12:07:14.677254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 533/1104] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:15.032456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:15.033280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:15.040176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.040664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.041103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.041839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.042296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.042720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.162343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:15.164686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:15.171130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.171619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.172084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.172787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.173046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:15.173268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.173699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.177795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:15.181347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f516c13-7513-420b-abe4-04871dcadd01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152745 Sep 19 12:07:15.181892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 572/1105] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:15.206649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3f0fd979-e090-481c-be0b-961497e2f7bf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048389 Sep 19 12:07:15.207223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 534/1106] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:15.547761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:15.548375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:15.555159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.555645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.556138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.556833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.557287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.557801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.689018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:15.690508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:15.693495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:15.698522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8cefada5-27c1-4d4d-83fb-c377688e3d7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154747 Sep 19 12:07:15.699314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 573/1107] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:15 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:15.700209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.701157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.701157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.701874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.702339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.702770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.734743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6cc90824-1bc3-4422-9887-e28dcd49b464 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048881 Sep 19 12:07:15.735318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 535/1108] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:16.205456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:16.206095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:16.208878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=68 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:16.214085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.214836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.215266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.215972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.216425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.216850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.220660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:16.222849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:16.229727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.230243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.230674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.231369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.231822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.232237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.266560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85466e86-02fc-49ff-8fdd-fdaae4714a2a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049766 Sep 19 12:07:16.267147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 536/1109] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:16.364755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:16.372674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f73ee5cd-36af-450d-8db0-d7feda50fa7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.171153 Sep 19 12:07:16.373246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 574/1110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:16.722649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:16.723257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:16.729194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.729680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.730230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.730924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.731379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.731818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.747658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:16.750756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:16.757378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.757888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.758323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.759026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.759472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.759915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.799627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28cdb2b2-6269-425d-986b-479264f1a32a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049421 Sep 19 12:07:16.799627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 575/1111] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:16.864734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:16.873722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aaa51006-37a3-4f7f-8259-ae44f123f9af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154886 Sep 19 12:07:16.874330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 537/1112] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:16 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:17.282329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:17.284544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:17.291925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.292423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.292861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.293586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.294093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.294519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.329709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-675ef8b1-97fd-4465-87e0-560f62fe221e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051611 Sep 19 12:07:17.330316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 576/1113] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:17.396262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:17.396983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:17.403499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.403918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.404345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.405032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.405482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.405941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.541561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:17.549718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-957a27dd-1975-4b61-97d0-ee3193a606e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157267 Sep 19 12:07:17.550322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 538/1114] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:17.807015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:17.809973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:17.815990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.816480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.816916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.818037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.818583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.819022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.850280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4be5e68c-f5fa-4fb1-8e57-e78fe0061e37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048569 Sep 19 12:07:17.850846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 577/1115] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:17.898013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:17.898621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:17.904543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.905051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.905486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.906204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.906657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.907076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.042586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:18.050763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b1c80d45-da22-4214-89d0-6dd52834d38d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157154 Sep 19 12:07:18.051329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 539/1116] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:17 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:18.342957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:18.345137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:18.351887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.352350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.352783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.353489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.353979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.354405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.386285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f0832cf-f5aa-4506-b63f-f3b2a4076e46 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047452 Sep 19 12:07:18.386867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 578/1117] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:18.574901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:18.575484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:18.582193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.582686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.583136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.583838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.584326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.584755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.719414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:18.728536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-753843f3-40d9-46b6-861b-379d6fe98ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157620 Sep 19 12:07:18.729111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 540/1118] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:18.863251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:18.865943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:18.871881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.872368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.872802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.873498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.874061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.874482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.905576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-255bacf6-414a-4798-8b45-2027f64f76b2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046398 Sep 19 12:07:18.906233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 579/1119] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:19.077391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:19.078039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:19.084090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.084578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.085021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.085725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.086210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.086637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.214813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:19.223195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75b0d8d5-8d98-4c63-a400-86e84d2daad5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149706 Sep 19 12:07:19.224484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 541/1120] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:19 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:19.399991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:19.402889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:19.410558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.411079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.412080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.413043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.413592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.413980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.445951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d208e3ec-87be-4244-b54c-71718ccb3f11 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050906 Sep 19 12:07:19.446627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 580/1121] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:19.752121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:19.752674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:19.759614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.760096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.760536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.761231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.761682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.762139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.893496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:19.902205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6e0c1ad-bec2-474f-93c6-003e3c7611f8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154016 Sep 19 12:07:19.902779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 542/1122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:19.917504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:19.919674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:19.925537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.926054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.926486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.927670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.928115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.928531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.958833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7106ba9e-792e-4605-8e07-a6ee07266ccf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Sep 19 12:07:19.959400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 581/1123] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:20.246776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:20.247388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:20.253406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.253927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.254371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:20.255662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.256115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.256539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:20.388027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:20.396916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e98c36fc-9b7a-4a45-be53-4e52d13141ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153982 Sep 19 12:07:20.397492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 543/1124] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:20 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:20.458884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:20.460911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:20.467641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.468230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.468726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:20.469415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.469879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.470297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:20.500286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c34d850-de6c-42ee-a584-ea30e2a350c1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045446 Sep 19 12:07:20.500865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 582/1125] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:20.925412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:20.926032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:20.933002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.933475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.933939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:20.934657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.935104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.935520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:20.971651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:20.973893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:20.979872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.980362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.980792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:20.981495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:20.981983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:20.982402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:21.010058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:21.015586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4a79df4-f68d-49ee-aaf1-d76a80ec8d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048042 Sep 19 12:07:21.019136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 583/1126] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:21.069667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:21.077428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-66261ba4-55ef-43bc-b3ee-cf08118a6194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155833 Sep 19 12:07:21.078021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 544/1127] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:21.420465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:21.421070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:21.427855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:21.428336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:21.428770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:21.429462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:21.429947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:21.430364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:21.514484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:21.516749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:21.522898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:21.523381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:21.523815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:21.524620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:21.525071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:21.525502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:21.556323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-949c517f-07ce-42e8-9d18-4416a751a2b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046003 Sep 19 12:07:21.556908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 545/1128] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:21.564044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:21.574237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85970135-0ec5-439b-b029-226a1b2fe7f1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157563 Sep 19 12:07:21.574873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 584/1129] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:21 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:22.030650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:22.032944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:22.040848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.041391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.041875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.042582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.043045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.043471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.076772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e39499e5-4292-4241-8b4d-5c267c5ad5e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050086 Sep 19 12:07:22.077347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 546/1130] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:22.102237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:22.102991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:22.109161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.109637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.110093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.110779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.111219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.111632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.248446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:22.256575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25ce9c28-b0af-4ae5-a468-eb0f60679920 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159160 Sep 19 12:07:22.257135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 585/1131] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:22.569173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:22.571408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:22.577308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.577815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.578257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.578959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.579565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.579993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.599096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:22.600337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:22.611154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.611645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.612074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.612777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.613229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.613651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.613779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf4ee268-889e-41ba-849e-e7e46a9c6cee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048609 Sep 19 12:07:22.614894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 547/1132] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:22.747079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:22.755311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80018829-bf3b-4df4-aa6f-afe262510922 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.161502 Sep 19 12:07:22.755882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 586/1133] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:22 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:23.090129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:23.092300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:23.099447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.099938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.100378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.101080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.101532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.101991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.132065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-973138e8-306d-4eb8-9342-2e00f15021d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Sep 19 12:07:23.132646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 548/1134] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:23.281096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:23.281695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:23.287676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.288144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.288572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.289254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.289697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.290155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.421083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:23.428957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ca003d0-44a1-470e-b23a-978edc8471b0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151742 Sep 19 12:07:23.429512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 587/1135] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:23.626718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:23.630431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:23.636811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.637290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.637743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.638511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.638988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.639408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.670391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-20d6ef58-2f27-4a57-9fba-23c903bbb9f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047825 Sep 19 12:07:23.670952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 549/1136] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:23.778462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:23.779107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:23.785482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.786062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.786506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.787201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.787664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.788086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.920316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:23.929241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bbfc385-95c2-42b3-bfaa-6f9b8cb8bff2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154630 Sep 19 12:07:23.929837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 588/1137] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:23 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:24.144621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:24.147143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:24.153655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.154184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.154624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.155361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.155821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.156265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.183833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:24.189392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-513b136e-5b8e-49da-ae2f-c7fc5557e825 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048816 Sep 19 12:07:24.189994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 550/1138] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:24.452315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:24.452865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:24.459435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.459917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.460351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.461039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.461485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.461943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.597241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:24.605645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b7e2875-6a53-4e3a-b966-323352cc1f62 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157339 Sep 19 12:07:24.606249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 589/1139] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:24.683520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:24.685719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:24.692556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.693362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.694118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.695337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.696127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.696642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.733201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-be5af295-5465-4331-8955-ac2e2516f051 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053989 Sep 19 12:07:24.741248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 551/1140] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:24.952634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:24.953251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:24.960279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.960797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.961239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.962002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.962459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.962877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.153410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:25.161822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a595f67-a2d3-41cd-a573-210dc6844391 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.213015 Sep 19 12:07:25.162392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 590/1141] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:24 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:25.202119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:25.204281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:25.210986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.211483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.211923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.212621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.213078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.213504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.244308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef4171a4-40cc-4ab2-88f0-b75f1560eb6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046176 Sep 19 12:07:25.244888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 552/1142] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:25.628886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:25.629641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:25.635526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.635990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.636418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.637115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.637565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.638014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.748814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:25.751122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:25.757151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.757637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.758113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.758812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.759261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.759694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.775518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:25.783478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-feee0cf1-c21e-483d-937c-dc61678ad2e4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158533 Sep 19 12:07:25.784152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 591/1143] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:25.792473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd2893b4-284d-42e4-b340-d3cee72c4c88 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047653 Sep 19 12:07:25.793062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 553/1144] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:26.184644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:26.185248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:26.191776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.192368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.192801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.193501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.193985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.194416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.257400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:26.259799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:26.266136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.266619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.267051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.267752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.268202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.268621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.300284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-038318ae-648c-45de-ad5c-13524ee87de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047329 Sep 19 12:07:26.301060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 554/1145] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:26.327335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:26.337882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1512a3f-ee3e-48f3-bbdd-7db6c6a4795e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157038 Sep 19 12:07:26.338593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 592/1146] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:26 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:26.805873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:26.808024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:26.808308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:26.809644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:26.814140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.814623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.814890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.815058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.815375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.815759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.815881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.816204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.816499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.816616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.817014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.818118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.847464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c1953b41-d679-427d-922f-cc8593cad0ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046077 Sep 19 12:07:26.848042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 555/1147] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:26.946894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:26.954631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf52dc48-e0e3-4c1d-8b16-0287b87696b8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150104 Sep 19 12:07:26.955195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 593/1148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:27.312789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:27.315043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:27.321419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.321933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.322377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.323069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.323540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.323946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.354280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b495bab-07b9-41ed-9443-f52fe31100cc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045335 Sep 19 12:07:27.355186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 556/1149] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:27.361249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:27.361878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:27.369133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.369668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.370129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.370834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.371283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.371703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.508165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:27.516404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a37aa975-3a7e-44a4-8b07-3cfa394e834c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158998 Sep 19 12:07:27.516975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 594/1150] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:27 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:27.860731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:27.862994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:27.869137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.869625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.870100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.870859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.871315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.871774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.902872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-059f0b55-ed91-4779-a73a-192c8dfbf237 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046196 Sep 19 12:07:27.903437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 557/1151] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:27.978170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:27.978779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:27.984685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.985168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.985608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.986328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:27.986794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:27.987203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.117271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:28.125001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4aa8fa1-e0dd-4534-91bd-d78e09f8ab04 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150688 Sep 19 12:07:28.125572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 595/1152] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:28.368644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:28.370765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:28.376737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.377221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.377658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.378388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.378845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.379271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.409007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b8891ed-c858-4d6d-b925-ee830b52c40d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Sep 19 12:07:28.409564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 558/1153] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:28.540285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:28.540881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:28.547546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.548029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.548465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.549158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.549619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.550077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.683406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:28.692572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e454f26f-695f-490a-89a5-a706343da8e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156286 Sep 19 12:07:28.693134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 596/1154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:28 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:28.916433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:28.918602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:28.924605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.925110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.925545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.926783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.927237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.927654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.957630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74363849-46ad-4705-b1d7-2a9c27cca4df tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045264 Sep 19 12:07:28.958214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 559/1155] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:29.148688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:29.149304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:29.155602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.155825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.156265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.156966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.157418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.157931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.289858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:29.297719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4210bee6-e1e0-469d-b889-9abdbea7c289 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153022 Sep 19 12:07:29.298368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 597/1156] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:29.420861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:29.423640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:29.431155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.431632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.432449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.432787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.433236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.433661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.462226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fefb7ef3-0b3e-4312-82da-fb8bda5a51bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045421 Sep 19 12:07:29.462773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 560/1157] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:29.716359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:29.717013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:29.724051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.724519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.724955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.725661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.726134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.726548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.858644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:29.866862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b7c94f5-909a-4342-82cb-df1c390b9c0c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154644 Sep 19 12:07:29.867427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 598/1158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:29 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:29.970690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:29.972889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:29.981677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.982151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.982594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.983312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.983770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.984199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.015023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-66b95029-c8a0-4fa3-9cf1-aa79ce72c28d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048349 Sep 19 12:07:30.015581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 561/1159] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:30.322452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:30.323062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:30.328969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.329445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.329906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.330603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.331052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.331472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.473040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:30.475633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:30.477833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:30.480810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b1f0ebd-031c-4afb-b316-c180b08a2663 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.162223 Sep 19 12:07:30.481424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 599/1160] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:30.484665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.485158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.485598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.486344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.486796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.487224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.519782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a807e7f7-e44a-4470-9837-53bda2878304 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048133 Sep 19 12:07:30.520435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 562/1161] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:30.890250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:30.890988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:30.897722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.898238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.898701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.899412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.899868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.900320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.919198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:31.028135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:31.030314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:31.036773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.037254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.037684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.038480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.038919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.039336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.039754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:31.048170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d506d01a-49a2-41f2-8210-977c82fd9f53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.161988 Sep 19 12:07:31.048737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 600/1162] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:30 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:31.070633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ee2e36d-8101-43d4-8d9e-dc1269361efa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046521 Sep 19 12:07:31.071200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 563/1163] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:31.505231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:31.505803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:31.511792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.512275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.512710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.513399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.513875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.514300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.532457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:31.534766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:31.541570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.542103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.542544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.543271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.543716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.544151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.580171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c74fca0a-2c1d-4944-8ad3-8c2657776247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051626 Sep 19 12:07:31.580758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 564/1164] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:31.662765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:31.670297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69d3e125-aa95-4fa8-a6e8-495dc4d5fb55 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.169600 Sep 19 12:07:31.670861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 601/1165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:32.072664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:32.073266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:32.079292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.079776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.080206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.080897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.081344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.081782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.082778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:32.084929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:32.091550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.092022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.092459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.093162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.093616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.094076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.125021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57964749-40a9-48bb-a2a7-ca345b0cf1f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046175 Sep 19 12:07:32.125600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 602/1166] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:32.232184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:32.241121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8b35a94-325f-4995-9e6a-cb38cb01533a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.172284 Sep 19 12:07:32.241692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 565/1167] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:32 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:32.593676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:32.595824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:32.602209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.602684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.603112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.603797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.604244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.604658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.634977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fcf4749-cc1b-46d3-9abe-8c96d8e49ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Sep 19 12:07:32.635550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 603/1168] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:32.693099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:32.693834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:32.700491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.701078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.701592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.702398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.702927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.703361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.843350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:32.851928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45e0c23f-b63d-4363-a5cd-b28106aa9dfa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.163278 Sep 19 12:07:32.852433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 566/1169] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:33.140521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:33.142618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:33.150189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.150682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.151111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.151812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.152263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.152678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.187819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1919ae8-fe41-40f6-947f-4fddb9ac7642 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051462 Sep 19 12:07:33.188380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 604/1170] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:33.264810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:33.265413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:33.271453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.271940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.272378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.273080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.273533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.273990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.290091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:33.403782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:33.412678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b9f996d-a885-4d8a-88d2-8c567fecac36 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151775 Sep 19 12:07:33.413260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 567/1171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:33 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:33.648093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:33.650302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:33.656299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.656718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.657147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.657901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.658350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.658768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.688796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b70bf735-785b-40fa-b7ff-112f46cce85e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Sep 19 12:07:33.689362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 605/1172] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:33.877793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:33.878424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:33.886145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.886632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.887069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.888160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.888740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.889293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.024653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:34.033821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c381016-fda8-48bd-9534-487304a41ff1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159822 Sep 19 12:07:34.034407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 568/1173] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:34.201342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:34.203549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:34.210187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:34.210668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:34.211101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.211793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:34.212240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:34.212661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.243344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5b5ceb2-c20c-4de1-bb13-9d783e8d48fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045884 Sep 19 12:07:34.243826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 606/1174] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:34.435742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:34.436350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:34.443000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:34.443482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:34.443919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.444619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:34.445086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:34.445518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.580489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:34.589175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bbabdba3-f8cb-4841-bd8b-5ae9ac3bdc4a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157420 Sep 19 12:07:34.590051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 569/1175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:34 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:34.700883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:34.703105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:34.709092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:34.709571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:34.710047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.710754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:34.711205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:34.711621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.746240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff774eb2-336d-43ab-b5a1-dbed2af8401b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049351 Sep 19 12:07:34.746816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 607/1176] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:35.057625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:35.058264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:35.064767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.065250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.065687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.066421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.066878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.067302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.203233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:35.212311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50d97dc6-bbfd-48ad-ae20-575c654f57bd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158595 Sep 19 12:07:35.213457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 570/1177] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:35.256792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:35.259039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:35.265397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.265919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.266350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.267042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.267488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.267906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.298300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a80e3a8-7cc6-497b-81c9-fee0bdb3d5e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045982 Sep 19 12:07:35.298777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 608/1178] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:35.612425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:35.613093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:35.619199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.619690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.620157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.620867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.621320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.621747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.757222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:35.765814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c51d8ca6-e59d-4040-9de5-3ed90a1558a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157219 Sep 19 12:07:35.766402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 571/1179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:35 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:35.842301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:35.844912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:35.850806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.851211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.851638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.852430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.852878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.853293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.885063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d728515c-7f3b-4c66-8877-07337a2da78d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130914 Sep 19 12:07:35.885613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 609/1180] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:36.236736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:36.237358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:36.244939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.245433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.245910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.246629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.247090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.247519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.311305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:36.313713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:36.320116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.320608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.321066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.321754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.322264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.322715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.361175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e57fa17-6659-45a3-9c8c-b6b62253f007 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053754 Sep 19 12:07:36.361886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 610/1181] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:36.388561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:36.396864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-52f3caa7-3717-4ead-a600-93d56e05df0c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.164111 Sep 19 12:07:36.397434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 572/1182] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:36.789902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:36.790506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:36.796488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.796964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.797394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.798111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.798557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.798972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.898636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:36.901080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:36.907697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.908216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.908647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.909551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:36.910027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:36.910515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:36.940532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:36.944461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ed16cc2-7c99-47e4-8140-1ad2f3f344ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051448 Sep 19 12:07:36.945880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 573/1183] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:36.950624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b859763-9013-464a-ad86-470abb2ec128 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.165040 Sep 19 12:07:36.951184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 611/1184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:36 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:37.375008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:37.377178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:37.384276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.384764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.385202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.385933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.386393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.386821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.416649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8dcd639c-b4ed-4032-8504-3cf95aabc57b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045629 Sep 19 12:07:37.417308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 574/1185] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:37.421313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:37.421949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:37.428405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.428881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.429308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.430054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.430463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.430883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.563707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:37.571459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1efc5618-c4f4-43ac-a57a-e2c3f8bf9ecf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153919 Sep 19 12:07:37.572030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 612/1186] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:37.957712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:37.959913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:37.966230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.966719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.967156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.967940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.968330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.968755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.975600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:37.976286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:37.983088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.983578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.984393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.985113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.985569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.986093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:38.003810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-615e0c9f-6888-482a-8e77-f163cec17352 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050528 Sep 19 12:07:38.008720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 575/1187] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:38.127584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:38.136189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0233dcb4-0d60-43c1-bdf0-4bb24f829c0e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.165674 Sep 19 12:07:38.136754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 613/1188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:37 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:38.429344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:38.431621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:38.438621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:38.439117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:38.439564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:38.440282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:38.440770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:38.441196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:38.474598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b39d5162-12d1-407c-a5da-b9e873d0abe9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049475 Sep 19 12:07:38.475167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 576/1189] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:38.594793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:38.595393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:38.601493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:38.602006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:38.602436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:38.603178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:38.603621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:38.604040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:38.736245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:38.744482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dad9e388-ad4d-495b-a79a-d3b617793e9e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153593 Sep 19 12:07:38.745032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 614/1190] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:39.016728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:39.019018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:39.025373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.025889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.026333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.027042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.027497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.027918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.061476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a970986c-ec5b-40b8-95f4-06800fdb2fbd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048732 Sep 19 12:07:39.062105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 577/1191] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:39.206746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:39.207474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:39.213723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.214230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.214913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.215607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.216053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.216470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.347671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:39.364661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b9ee3c3-9abe-4a20-89dc-8eaed0d8cb81 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.208580 Sep 19 12:07:39.365279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 615/1192] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:39 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:39.487314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:39.489502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:39.496260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.496743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.497176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.497896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.498349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.498776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.528547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a47ffcb2-f3bc-4c0c-ba4d-03bb70c898eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045201 Sep 19 12:07:39.529101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 578/1193] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:07:39.768216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:39.768813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:39.775366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.775848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.776282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.776981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:39.777452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:39.777880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:39.911993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:39.920155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec44a778-d1ac-4c50-9d13-2b94574ab87f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155703 Sep 19 12:07:39.920848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 616/1194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:39 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:40.074052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:40.076256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:40.087118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.087517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.087979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:40.088632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.089088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.089959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:40.121005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d1dd9c9e-90fa-4c03-a715-85a684d0488f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050899 Sep 19 12:07:40.121589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 579/1195] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:40.387611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:40.388252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:40.395082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.395567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.396004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:40.396724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.397179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.397631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:40.401692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:40.529423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:40.538232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6f939c6-5396-43de-bd39-c67f25808137 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154430 Sep 19 12:07:40.538787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 617/1196] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:40 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:40.541150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:40.543360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:40.545819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:40.551872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.552367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.552806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:40.553514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.553997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.554425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:40.584776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57a555ca-05cf-443a-a43c-1820c4930800 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047665 Sep 19 12:07:40.585333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 580/1197] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:40.946180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:40.946786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:40.952935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.953508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.954026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:40.954718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:40.955168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:40.955588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:41.086502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:41.094689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1af5d3bd-815b-4923-af12-72f506de30ce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152428 Sep 19 12:07:41.095246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 618/1198] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:41.133013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:41.135229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:41.141213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:41.141700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:41.142174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:41.142885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:41.143409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:41.143776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:41.176941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38118811-ede3-4123-9b80-63b948802e49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047866 Sep 19 12:07:41.177515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 581/1199] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:41.561880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:41.562491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:41.570057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:41.570538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:41.570979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:41.571675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:41.572130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:41.572564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:41.597033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:41.599413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:41.605944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:41.606389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:41.606825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:41.607559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:41.608012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:41.608436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:41.640841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-edaf5afa-2a2f-4e10-aa1b-59d40dd9379d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048042 Sep 19 12:07:41.641417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 582/1200] 10.222.0.88 () {60 vars in 1343 bytes} [Mon Sep 19 12:07:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 12:07:41.711678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:41.720084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d136699-d0f1-43f4-a3b5-4838a6d62c2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.162223 Sep 19 12:07:41.720649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 619/1201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:41 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:42.120144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:42.120754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:42.126781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.127268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.127706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.128408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.129394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.130019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.188741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:42.191151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:42.197745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.198283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.198700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.199409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.199861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.200285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.238756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a72f5cf6-42f2-4999-96ad-3626bbd88f73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053996 Sep 19 12:07:42.239984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 620/1202] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:42.267263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:42.275855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-83824075-65d8-4528-8eb4-856dd62f4901 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159569 Sep 19 12:07:42.276416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 583/1203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:42.654705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:07:42.656901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:42.663416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.663889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.664320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.665010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.665517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.665912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.743678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:42.744342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:42.750894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-074f8f46-22ac-495e-822d-9c3b666aea23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/action" status: 200 len: 37646 microversion: 2.20 time: 0.100056 Sep 19 12:07:42.751533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.751712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 621/1204] 10.222.0.88 () {62 vars in 1319 bytes} [Mon Sep 19 12:07:42 2022] POST /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2/action => generated 37646 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:07:42.752050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.752532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.753316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:42.753791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:42.754925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:42.758021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:42.891455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:42.899946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee322ded-8981-4038-96fa-bdc0b6b104c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.160193 Sep 19 12:07:42.900524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 584/1205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:42 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:43.251014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:43.253250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:43.260465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:43.260950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:43.261393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:43.262119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:43.262578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:43.263006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:43.299125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:43.299901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:43.301909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16543959-14c6-49b8-8496-71e49f88442e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055130 Sep 19 12:07:43.302520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 622/1206] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:43.306437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:43.307005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:43.307548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:43.308144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:43.308593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:43.309093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:43.441737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:43.449548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aee817ad-2c94-4bb0-a0d0-3e6b96a3875b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154156 Sep 19 12:07:43.450056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 585/1207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:43.922490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:43.923094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:43.930341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:43.930827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:43.931259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:43.931953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:43.932400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:43.932823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:44.067038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:44.075371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74c61b41-6f0b-4202-8075-94419ed04469 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156620 Sep 19 12:07:44.075828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 623/1208] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:43 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:44.315815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:44.318300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:44.325007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:44.325541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:44.325953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:44.326648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:44.327094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:44.327509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:44.359475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1abd5b3e-8b83-4178-813f-efa278404650 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 Sep 19 12:07:44.360053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 586/1209] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:44.474201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:44.474942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:44.477246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:44.482657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:44.483146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:44.483581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:44.484281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:44.484770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:44.485196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:44.631805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:44.639839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6dab116-07ea-464d-ba8f-410e9e493995 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.170047 Sep 19 12:07:44.640409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 624/1210] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:45.098535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:45.099299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:45.106050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:45.106534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:45.106962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:45.107659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:45.108103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:45.108524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:45.238611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:45.246895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a39122b4-51b4-46b3-95ba-c4e22fdec092 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152586 Sep 19 12:07:45.247469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 587/1211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:45 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:45.373714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:45.375903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:45.383466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:45.383992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:45.384424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:45.385177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:45.385629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:45.386089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:45.416740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-875e2163-0a10-4646-8684-4d965001e277 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Sep 19 12:07:45.417510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 625/1212] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:45.664144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:45.664687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:45.671289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:45.671815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:45.672288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:45.673025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:45.673481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:45.673972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:45.812726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:45.824273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-83f41a19-c686-42ac-b99c-3cc639201eab tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.163973 Sep 19 12:07:45.824933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 588/1213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:46.271126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:46.271767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:46.280013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:46.280723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:46.281522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:46.282845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:46.283392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:46.283839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:46.364425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:07:46.364787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:07:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 (ip 10.222.0.88) !!! Sep 19 12:07:46.429619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:46.430742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:46.431971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:46.438494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:46.438984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:46.439449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:46.440136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5aea6076-cf0b-4416-925a-4a2fdb2e4284 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.173169 Sep 19 12:07:46.440243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:46.440594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:46.441206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 626/1214] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:46 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:46.442133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:46.473490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d6be723-d4f3-4c10-b46a-be540e2b07a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Sep 19 12:07:46.474320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 589/1215] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:46.849269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:46.849799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:46.855725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:46.856207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:46.856636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:46.857318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:46.857778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:46.858198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:46.995357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:47.003102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-468224ec-b520-4b35-b9d9-3c2294c8a000 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158314 Sep 19 12:07:47.003714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 627/1216] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:47.464614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:47.465169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:47.471585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:47.472064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:47.472495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:47.473186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:47.473635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:47.474091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:47.486213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:47.488447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:47.494904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:47.495394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:47.495834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:47.496542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:47.497062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:47.497508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:47.531817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e4c9ec3-7c0a-45e7-aa5e-5481d29ce3ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049655 Sep 19 12:07:47.532721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 628/1217] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:47.608784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:47.617211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-da32877c-0cb0-453f-8e0c-689f07a4fc2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156727 Sep 19 12:07:47.617821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 590/1218] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:47 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:48.026251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:48.026870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:48.032927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:48.033406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:48.033868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:48.034564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:48.035516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:48.035939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:48.168445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:48.177006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0120cf88-0bcd-4f8c-bfed-d7b68dd2d892 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154612 Sep 19 12:07:48.177578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 629/1219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:48.544495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:48.546782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:48.553453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:48.554002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:48.554446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:48.555155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:48.555609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:48.556037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:48.586257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a7b92b5-9dec-482b-aa03-928b1b4a538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Sep 19 12:07:48.586951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 591/1220] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:48.640763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:48.641374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:48.649229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:48.649728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:48.650205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:48.650917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:48.651373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:48.651800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:48.800744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:48.809030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90ef902f-4fde-4715-a363-5812c773e07e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.172138 Sep 19 12:07:48.809589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 630/1221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:48 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:49.200607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:49.201199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:49.207232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:49.207713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:49.208150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:49.208846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:49.209298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:49.209749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:49.338985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:49.348072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3f2b3a75-20a8-4c39-b77c-95cee0517105 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151528 Sep 19 12:07:49.348663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 592/1222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:49.599448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:49.601618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:49.607609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:49.608089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:49.608519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:49.609213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:49.609661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:49.610110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:49.639651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44e3da2a-485c-4ce3-b5d2-5212d4fb7997 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Sep 19 12:07:49.640215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 631/1223] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:49.832621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:49.833224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:49.839927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:49.840406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:49.840837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:49.841524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:49.842000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:49.842421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:49.975062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:49.983192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5db408b6-2585-40da-91a4-9334d2fb541d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154523 Sep 19 12:07:49.983770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 593/1224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:49 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:50.377793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:50.379109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:50.385499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:50.386039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:50.386453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:50.387153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:50.387617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:50.388016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:50.532519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:50.540817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d3e5e5c3-9a24-42f7-b529-b7caebc61ab5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.166859 Sep 19 12:07:50.541409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 632/1225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:50.652229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:50.654458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:50.660569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:50.661052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:50.661495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:50.662226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:50.662680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:50.663108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:50.693156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df373e51-fe40-48fb-97b2-506ff96185c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Sep 19 12:07:50.693715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 594/1226] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:51.006180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:51.006703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:51.012800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:51.013287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:51.013724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:51.014461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:51.014915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:51.015375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:51.151006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:51.159129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3175807-db6f-4b61-be08-79406201fb74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157563 Sep 19 12:07:51.159681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 633/1227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:51 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:51.564842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:51.565385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:51.572101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:51.572593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:51.573029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:51.573732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:51.574213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:51.574635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:51.705911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:51.707978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:51.708869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:51.715548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:51.716165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8820d5e1-d4b5-4894-b3ff-7e16fb6892c9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155419 Sep 19 12:07:51.716300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:51.716636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:51.716757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 595/1228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:51.717348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:51.717898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:51.718321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:51.722247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:51.749967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a9cf03e-dc22-485e-94b6-f06787f6baa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048173 Sep 19 12:07:51.750539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 634/1229] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:52.182539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:52.183149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:52.189239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:52.189756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:52.190219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:52.191648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:52.192138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:52.192562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:52.322246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:52.330781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4e7086e6-5c2a-4caa-8a00-9e82d21ec9aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152085 Sep 19 12:07:52.331348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 596/1230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:52 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:52.740981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:52.741544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:52.748205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:52.748715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:52.749145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:52.750002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:52.750455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:52.750875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:52.763028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:52.765214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:52.771987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:52.772477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:52.772921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:52.773634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:52.774119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:52.774546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:52.807498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8bc74ac-d75b-4e30-8581-938076934a8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048362 Sep 19 12:07:52.808077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 597/1231] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:52.887147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:52.895440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-782deedc-ef7f-4894-b145-0c9ae893fdcc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159090 Sep 19 12:07:52.896007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 635/1232] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:53.354213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:53.354823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:53.361007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:53.361496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:53.361968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:53.362684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:53.363228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:53.363660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:53.493425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:53.502082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b8b5f79-022b-48d9-a369-2bb7aefd10c8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151762 Sep 19 12:07:53.502654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 598/1233] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:53 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:53.820987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:53.823351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:53.830138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:53.830626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:53.831063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:53.832014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:53.832441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:53.832870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:53.863973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7db92efd-07f2-44d4-8fea-17968e774ca0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047772 Sep 19 12:07:53.864571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 636/1234] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:53.919586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:53.920237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:53.927346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:53.927847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:53.928273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:53.928968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:53.929419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:53.929861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:54.069586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:54.077886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-682f8deb-565b-4fa3-8fd8-5c45d6c63c03 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.161942 Sep 19 12:07:54.078290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 599/1235] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:54.526491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:54.527283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:54.533232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:54.533735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:54.534182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:54.535821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:54.536286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:54.536710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:54.670372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:54.679031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee7a5a9a-5eee-4c77-9c43-8aa7362779e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156464 Sep 19 12:07:54.679602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 637/1236] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:54 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:54.876269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:54.878987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:54.884979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:54.885467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:54.885939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:54.886647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:54.887102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:54.887534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:54.913580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:54.919113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3ab4bac6-5c6c-49d9-89d4-9a77bba3ccbb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047183 Sep 19 12:07:54.919711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 600/1237] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:55.103172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:55.103889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:55.110751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:55.111278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:55.111866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:55.112570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:55.113049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:55.113498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:55.247510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:55.255831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59b78ca9-8b46-45f5-90a3-8b23d289517d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158851 Sep 19 12:07:55.256403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 638/1238] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:55.701603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:55.702240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:55.708859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:55.709347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:55.709806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:55.710515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:55.710972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:55.711401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:55.895776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:55.904152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a8f955a-e2c5-457f-a886-4575d78e36eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.206658 Sep 19 12:07:55.904736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 601/1239] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:55 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:55.931825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:55.934042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:55.940095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:55.940577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:55.941005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:55.941699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:55.942169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:55.942585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:55.973906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4eda2aa9-f6d9-46e1-9cb5-0d37f0543be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045940 Sep 19 12:07:55.974470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 639/1240] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:56.279421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:56.280020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:56.286096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:56.286581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:56.287021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:56.287711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:56.288167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:56.288588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:56.428722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:56.436497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8369e6b8-cb84-4297-b5ea-8077f6f8506c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.161213 Sep 19 12:07:56.437080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 602/1241] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:56.928128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:56.928764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:56.935272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:56.935751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:56.936186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:56.936886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:56.937343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:56.937959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:56.985894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:56.988582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:56.995056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:56.995552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:56.995970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:56.996665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:56.997111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:56.997522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:57.028481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6747e9e-395d-45fe-8e4d-cdd20ce5eee4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046491 Sep 19 12:07:57.029059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 603/1242] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:07:57.073053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:57.081501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99de8c8b-3957-4118-9538-d931fc187e63 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157675 Sep 19 12:07:57.082199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 640/1243] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:56 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:57.461234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:57.461860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:57.468107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:57.468591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:57.469056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:57.469744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:57.470224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:57.470647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:57.602078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:57.609807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d7e87b0-4b57-4b7a-b134-6e3262765a01 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153121 Sep 19 12:07:57.610381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 604/1244] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:58.041644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:58.043935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:58.050919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:58.051410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:58.051844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:58.052550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:58.053003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:58.053426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:58.083960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4adcd229-e463-4b3d-9e98-87c1f5795047 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046281 Sep 19 12:07:58.084528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 641/1245] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:58.104580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:58.105186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:58.111350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:58.111838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:58.112278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:58.113010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:58.113462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:58.113925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:58.250183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:58.259046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8629f39-e845-449b-a843-9f96ec77a8bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158554 Sep 19 12:07:58.259628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 605/1246] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:58 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:58.633326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:58.633978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:58.640166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:58.640653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:58.641080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:58.641774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:58.642233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:58.642655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:58.777235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:58.796429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46af7cb1-30d9-43d8-9e9f-43afb7fff2b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.166864 Sep 19 12:07:58.797295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 642/1247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:59.096661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:59.099546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:59.106869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:59.107361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:59.107833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:59.108543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:59.109004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:59.109437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:59.139826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f3cfe81-ed28-4d9b-ae8b-dc0fb5f56869 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047135 Sep 19 12:07:59.140408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 606/1248] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:07:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:59.282278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:59.282950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:59.289421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:59.289933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:59.290372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:59.291093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:59.292385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:59.292862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:59.428465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:59.437672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b924b716-d19d-4316-b111-eebfd3ed8f70 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159278 Sep 19 12:07:59.438299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 643/1249] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:59 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:59.827313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:59.827935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:59.834483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:59.835005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:59.835735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:59.837005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:59.837599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:59.838202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:59.976337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:59.984103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d425896c-0e33-480e-9df8-af8b9370c446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160665 Sep 19 12:07:59.984677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 607/1250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:00.152638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:00.154890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:00.161302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:00.161890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:00.162246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:00.162959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:00.163400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:00.163932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:00.194091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb2f9952-5e61-4b51-919e-1310acc4f4a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045592 Sep 19 12:08:00.194667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 644/1251] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:00.462206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:00.462760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:00.469388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:00.469907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:00.470340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:00.471028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:00.471477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:00.471954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:00.603808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:00.612070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-297fc556-eeef-49b4-9ec8-20b58576168e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153872 Sep 19 12:08:00.612636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 608/1252] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:00 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:01.008582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:01.009188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:01.015600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:01.016078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:01.016509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:01.017196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:01.017647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:01.018098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:01.153982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:01.161658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c60010f-d7f6-4bae-87f5-083690650ac7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157057 Sep 19 12:08:01.162261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 645/1253] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:01.207011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:01.209341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:01.216020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:01.216514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:01.216948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:01.217659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:01.218143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:01.218566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:01.250102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aebc3f20-825a-4aa7-bcbe-8c8df671e758 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047148 Sep 19 12:08:01.250669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 609/1254] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:01.634894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:01.635506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:01.641737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:01.642258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:01.642692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:01.643390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:01.643900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:01.644327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:01.772616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:01.780905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-966e573c-62d9-4ea5-8abd-80eb6e4cd7ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149926 Sep 19 12:08:01.781477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 646/1255] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:01 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:02.185329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:02.185877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:02.192641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:02.193127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:02.193559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:02.194343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:02.194803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:02.195228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:02.264103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:02.266303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:02.274316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:02.274801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:02.275283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:02.276031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:02.276479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:02.276901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:02.308553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f85aba5d-ac8d-4078-8334-648b5ca56582 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048556 Sep 19 12:08:02.309134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 647/1256] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:02.330972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:02.339747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5e25306-229c-41b8-927f-e901556cc11e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158070 Sep 19 12:08:02.340360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 610/1257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:02.805140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:02.805990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:02.812101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:02.812585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:02.813015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:02.813702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:02.814210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:02.814630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:02.949740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:02.958446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30e1efc0-839f-4e80-9cf7-9f2efaf4dc49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157178 Sep 19 12:08:02.958998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 648/1258] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:02 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:03.322094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:03.324305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:03.330804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:03.332008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:03.332333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:03.333041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:03.333503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:03.333968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:03.363768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:03.364412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:03.364686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cdea3f84-090a-404b-bd0b-6c6c0bc76fcb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046604 Sep 19 12:08:03.365348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 611/1259] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:03.371057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:03.371546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:03.372009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:03.372765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:03.373270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:03.373696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:03.512552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:03.520280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9fbcc1d-ee91-41d7-b19e-9925310b55e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160643 Sep 19 12:08:03.520843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 649/1260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:03.981275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:03.981961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:03.988924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:03.989419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:03.989902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:03.990611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:03.991071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:03.991501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:04.127824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:04.136837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78824ab9-aba5-4542-90d4-d90fe657d1a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159357 Sep 19 12:08:04.137413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 612/1261] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:03 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:04.377317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:04.379895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:04.386315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:04.386797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:04.387225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:04.387922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:04.388369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:04.388793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:04.415258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:04.420944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f69e3e0a-2ddf-42ca-a76d-e254e28e8c8b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047535 Sep 19 12:08:04.421527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 650/1262] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:04.543757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:04.544535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:04.551355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:04.551837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:04.552264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:04.552955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:04.553409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:04.553864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:04.699191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:04.707525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b7d1a4d-eb43-4459-8819-976c03f8be37 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.167682 Sep 19 12:08:04.708095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 613/1263] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:05.160884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:05.161672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:05.168538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:05.169133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:05.169601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:05.170328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:05.170780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:05.171200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:05.311495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:05.320042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88e0241c-54ba-456d-8e17-9c039ae5a130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.163426 Sep 19 12:08:05.320617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 651/1264] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:05 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:05.434017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:05.436268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:05.443042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:05.443525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:05.443959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:05.444662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:05.445108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:05.445526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:05.475310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f18f2e0-83fe-4684-93a5-8eb83a5b6713 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045478 Sep 19 12:08:05.475860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 614/1265] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:05.731180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:05.731730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:05.738100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:05.738616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:05.739042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:05.739736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:05.740206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:05.740636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:05.870898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:05.878427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ddbe1bce-ea6c-4524-b877-7e56c9d57273 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151227 Sep 19 12:08:05.878983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 652/1266] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:06.343483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:06.344085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:06.350752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:06.351243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:06.351722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:06.352542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:06.353028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:06.353468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:06.488707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:06.490774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:06.490916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:06.497286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:06.497789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:06.498227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:06.498924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:06.499026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0144240c-424f-4e16-954f-d74b7c6a87d8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159662 Sep 19 12:08:06.499375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:06.499501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 615/1267] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:06 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:06.505848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:06.529296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae5a857f-987a-4d8c-b1b7-e217960e64b3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045277 Sep 19 12:08:06.529880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 653/1268] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:06.902131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:06.902747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:06.908696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:06.909745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:06.910236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:06.910937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:06.911392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:06.911820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:07.043153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:07.051828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6b63c61-8ca5-474c-9e70-a86e2c988433 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153629 Sep 19 12:08:07.052406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 616/1269] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:07.523195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:07.523812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:07.530200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:07.530671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:07.531101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:07.531784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:07.532226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:07.532668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:07.542759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:07.544935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:07.551465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:07.551953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:07.552393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:07.553107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:07.553565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:07.554019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:07.569140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:07.587708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5dc5731d-d861-4ebb-b2b9-38db2a6c86c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048846 Sep 19 12:08:07.588274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 617/1270] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:07.664966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:07.673638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27f8642a-2531-4168-b144-3bb98b2f02cc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154492 Sep 19 12:08:07.678027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 654/1271] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:07 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:08.074788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:08.075407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:08.081709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:08.082239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:08.082681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:08.083388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:08.083846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:08.084277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:08.222447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:08.230285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3e7f458-1a69-4522-a218-924cb7f3361a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159398 Sep 19 12:08:08.230860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 618/1272] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:08.601280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:08.603440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:08.609731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:08.610245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:08.610674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:08.611358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:08.611798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:08.612212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:08.641968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f24ed785-3439-4eda-90a9-eb1fad73cabe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Sep 19 12:08:08.642517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 655/1273] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:08.695979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:08.696565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:08.702905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:08.703374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:08.703803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:08.704486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:08.704925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:08.705340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:08.834299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:08.842789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e290368-d456-4f8e-8083-97799d9cdeb2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150601 Sep 19 12:08:08.843365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 619/1274] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:08 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:09.254874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:09.255469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:09.261458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:09.261973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:09.262403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:09.263077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:09.263522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:09.263935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:09.395174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:09.402980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7fb8edf9-e2c3-4b1d-ac6f-ffc76f7fc1c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152373 Sep 19 12:08:09.403453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 656/1275] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:09.655191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:09.657488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:09.663959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:09.664446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:09.664882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:09.665587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:09.666087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:09.666513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:09.696693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8104b452-1aac-4d79-8406-8259882365e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Sep 19 12:08:09.697374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 620/1276] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:09.867037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:09.867641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:09.874082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:09.874560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:09.874986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:09.875681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:09.876153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:09.876571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:10.013177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:10.021892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-484993f6-af65-45c8-9fc0-e24607ab2ef1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159332 Sep 19 12:08:10.022459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 657/1277] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:09 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:10.426104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:10.426713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:10.433259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:10.433827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:10.434186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:10.434870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:10.435315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:10.435734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:10.569394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:10.577194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eccea7d3-a5f3-4795-9717-f60565d8bafb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155024 Sep 19 12:08:10.577792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 621/1278] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:10.709177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:10.711299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:10.717676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:10.718188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:10.718626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:10.719326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:10.719776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:10.720193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:10.750140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6bfb2dbb-c1ca-443b-b2f3-ef6770e61b9a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Sep 19 12:08:10.750711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 658/1279] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:11.046374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:11.046977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:11.048816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:11.054542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:11.055027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:11.055458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:11.056167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:11.056601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:11.057026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:11.188371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:11.197213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5aa42534-c836-4c11-b864-4a31c26fac02 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.155762 Sep 19 12:08:11.197790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 622/1280] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:11 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:11.600977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:11.601533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:11.608210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:11.608696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:11.609132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:11.609876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:11.610336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:11.610765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:11.748922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:11.757046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-776f0abc-3b23-4d82-b4d3-d55e394c862c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160481 Sep 19 12:08:11.757614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 659/1281] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:11.762805 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:11.764999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:11.772178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:11.772660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:11.773100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:11.773834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:11.774405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:11.774833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:11.805229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f43e02dc-3f7f-4e5a-9ad5-d66889920ecd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046452 Sep 19 12:08:11.805838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 623/1282] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:12.220319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:12.220840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:12.227144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:12.227632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:12.228088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:12.228830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:12.229317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:12.229745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:12.366409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:12.374659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae774d16-d4ab-401b-a460-599f8b11e019 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158343 Sep 19 12:08:12.375223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 660/1283] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:12 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:12.781062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:12.781619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:12.788523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:12.788998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:12.789428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:12.790148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:12.790595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:12.791014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:12.817918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:12.820112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:12.826733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:12.827215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:12.827646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:12.828384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:12.828837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:12.829252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:12.860449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-960f360a-0c14-4e43-a9d5-78c6d8cfba46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046435 Sep 19 12:08:12.861033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 661/1284] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:12.922964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:12.931543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-105f237e-3065-4860-bf81-e4b917533333 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154439 Sep 19 12:08:12.932119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 624/1285] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:13.399016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:13.399529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:13.405474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:13.405985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:13.406414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:13.407097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:13.407546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:13.407963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:13.537675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:13.546068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-773a604a-3415-491a-aff7-bee58c7e6621 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152448 Sep 19 12:08:13.546637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 662/1286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:13 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:13.874024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:13.876228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:13.883737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:13.884221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:13.884660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:13.885361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:13.885849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:13.886275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:13.916302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8cf3b4f5-6a39-487d-848a-4e87796d9dac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046362 Sep 19 12:08:13.916871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 625/1287] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:13.955604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:13.956834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:13.963411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:13.963889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:13.964576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:13.965271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:13.965731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:13.966174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:14.313993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:14.321668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df2280fa-3a49-4884-a7ff-16f2c6223c16 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.369977 Sep 19 12:08:14.322256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 663/1288] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:14.569389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:14.570045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:14.576013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:14.576489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:14.576920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:14.577607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:14.578081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:14.578501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:14.714872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:14.723827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f4e6140-17f3-4910-ae72-22bd2b632796 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158374 Sep 19 12:08:14.724385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 626/1289] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:14 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:14.930530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:14.932766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:14.934760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=80 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:14.939917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:14.940435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:14.940901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:14.941658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:14.942137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:14.942559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:14.973340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d429b696-7e77-46dc-9ac4-f90a809073c4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046912 Sep 19 12:08:14.974048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 664/1290] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:15.344997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:15.345655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:15.352219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:15.352705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:15.353141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:15.353867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:15.354325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:15.354750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:15.494176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:15.505699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5195f841-bd34-49e6-a022-2a4bcf086d0e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.164251 Sep 19 12:08:15.506694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 627/1291] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:15.747548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:15.748175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:15.755019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:15.755544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:15.755930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:15.756622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:15.757067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:15.757484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:15.886248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:15.894534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a8db4d4-06f6-4e4d-8805-75fea1daaa65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150869 Sep 19 12:08:15.895109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 665/1292] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:15 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:15.986795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:15.989250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:15.995737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:15.996256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:15.996730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:15.997644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:15.997943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:15.998401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:16.028757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-25a66248-0ee3-4e84-b3d5-ba65badc4079 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046627 Sep 19 12:08:16.029322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 628/1293] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:16.529503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:16.530169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:16.537543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:16.538065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:16.538646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:16.539540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:16.540157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:16.540860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:16.677802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:16.686830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-919fd32e-9dfd-4d61-b2e3-eca1a2cce361 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.161213 Sep 19 12:08:16.687397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 666/1294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:16.919922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:16.920547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:16.932464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:16.933373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:16.934159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:16.934878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:16.935348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:16.935780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:17.042672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:17.044919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:17.051227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:17.051712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:17.052151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:17.052857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:17.053312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:17.053737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:17.071280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:17.071470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:17.079284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17aa651e-ddc3-4a07-9ab3-dc0260ed7a75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.165076 Sep 19 12:08:17.079841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 629/1295] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:16 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:17.085710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d51b32fa-32d4-4799-b3c9-12af3252ae22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Sep 19 12:08:17.086317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 667/1296] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:17.713921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:17.714796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:17.720720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:17.721204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:17.721636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:17.722359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:17.722809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:17.723230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:17.854569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:17.862228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-539c9db9-4d18-471f-b108-b7a5b6e1cba3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152398 Sep 19 12:08:17.862976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 630/1297] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:18.098772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:18.101034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:18.102465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:18.103088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:18.107513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:18.108001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:18.108439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:18.109138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:18.109443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:18.109592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:18.109973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:18.110121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:18.110422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:18.111153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:18.111613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:18.112049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:18.152504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a02f1b8-f2ed-4bf0-83e9-af48f3942ed9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058021 Sep 19 12:08:18.153228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 668/1298] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:18.244303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:18.252504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d85d97ce-d819-4c5d-bcfe-221bb6eb036e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153853 Sep 19 12:08:18.253069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 631/1299] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:18 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:18.885502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:18.886151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:18.892497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:18.893012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:18.893451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:18.894188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:18.894646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:18.895073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:19.026044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:19.034082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26a209c3-1854-463b-a261-8efcbb1822f3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152190 Sep 19 12:08:19.034655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 669/1300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:19.165463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:19.167680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:19.174132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:19.174621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:19.175062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:19.175757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:19.176212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:19.176639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:19.206288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fd95dc94-061c-4ae2-a98c-b6e4c454538b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Sep 19 12:08:19.206853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 632/1301] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:19.276187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:19.276787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:19.283230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:19.283736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:19.284163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:19.284835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:19.285279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:19.285695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:19.440469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:19.449190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18db9bad-68a9-40c7-a9e7-7fa99647ae74 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.176837 Sep 19 12:08:19.449788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 670/1302] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:19 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:20.058792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:20.059401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:20.065797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:20.066303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:20.066744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:20.068091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:20.068554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:20.069112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:20.199236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:20.206913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ad429e3-b54a-4503-bcd1-1bf4f32e9ef3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152056 Sep 19 12:08:20.207482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 633/1303] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:20.219541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:20.221746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:20.228232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:20.228716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:20.229152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:20.229880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:20.230341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:20.230764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:20.260046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa621191-7788-4679-8a58-1ba932dbb7e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Sep 19 12:08:20.260602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 671/1304] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:20.472556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:20.473092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:20.479816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:20.480304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:20.480741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:20.481433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:20.481918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:20.482343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:20.486238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:20.618123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:20.626487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-add98d9c-1b2a-4105-bc27-52f16a11f129 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158003 Sep 19 12:08:20.627062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 634/1305] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:20 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:21.229352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:21.229997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:21.238840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:21.239293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:21.239730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:21.240472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:21.240965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:21.241835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:21.273272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:21.275633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:21.282362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:21.282855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:21.283297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:21.284033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:21.284496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:21.285058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:21.315119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d2b8de64-a509-4fc7-b8df-59ac93ac1f7c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046307 Sep 19 12:08:21.315695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 635/1306] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:21.376268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:21.384950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1840edb-db09-444e-9695-602d758b3ac8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159261 Sep 19 12:08:21.385415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 672/1307] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:21.649995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:21.650560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:21.656456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:21.656940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:21.657375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:21.658228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:21.658684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:21.659104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:21.792156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:21.800424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3fb11d07-150f-4719-ba44-3ac4ea668e94 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154979 Sep 19 12:08:21.800990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 636/1308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:21 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:22.328214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:22.330572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:22.337690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:22.338208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:22.338649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:22.339616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:22.340077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:22.340498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:22.372553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ad9ca83-72c4-486a-ad2d-847386608893 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Sep 19 12:08:22.373115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 673/1309] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:22.408054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:22.408584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:22.416843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:22.417324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:22.417927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:22.418797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:22.419474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:22.419959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:22.560715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:22.568907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2c4172df-1e2e-4160-b5db-3ee78f7163a6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.164752 Sep 19 12:08:22.569472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 637/1310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:22.824128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:22.824781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:22.830697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:22.831205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:22.831633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:22.832310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:22.833435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:22.833875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:22.968883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:22.977246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ca69b9a-5b5d-4162-8285-119b81df3d0a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156994 Sep 19 12:08:22.977846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 674/1311] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:22 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:23.387207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:23.389422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:23.395631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:23.396118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:23.396553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:23.397259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:23.397719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:23.398279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:23.432167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a204cdba-76d0-43eb-b383-0709d5400baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050589 Sep 19 12:08:23.433110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 638/1312] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:23.592882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:23.593496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:23.600654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:23.601239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:23.601558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:23.602292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:23.602743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:23.603209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:23.741090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:23.751042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5c4f150-4eb0-4a1a-86e8-d58457cda216 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.162531 Sep 19 12:08:23.751617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 675/1313] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:24.003689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:24.004212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:24.010759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:24.011246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:24.011682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:24.012377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:24.012834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:24.013261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:24.139610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:24.148572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-10a0d712-4318-4099-b86c-b90a03a27adb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148844 Sep 19 12:08:24.149149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 639/1314] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:23 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:24.444896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:24.447071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:24.453067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:24.453539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:24.454001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:24.454684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:24.455128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:24.455556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:24.484294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9135686e-4a40-42ae-8e57-1681d1883a00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043949 Sep 19 12:08:24.484841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 676/1315] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:24.774766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:24.775376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:24.781793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:24.782267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:24.782705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:24.783406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:24.783954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:24.784382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:24.914525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:24.922565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ca40596-4ede-4c97-b474-9d4f8e7c55cd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151770 Sep 19 12:08:24.923135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 640/1316] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:25.171553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:25.172101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:25.178498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:25.178986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:25.179554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:25.180252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:25.180707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:25.181132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:25.317227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:25.325601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c236ff43-429c-4a4c-aba8-47a7a9d567dc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158231 Sep 19 12:08:25.326212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 677/1317] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:25 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:25.497193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:25.499394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:25.507019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:25.507502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:25.507941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:25.508646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:25.509102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:25.509528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:25.539101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46c27d96-6e1e-4b08-8aea-eed125aa62fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Sep 19 12:08:25.539653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 641/1318] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:25.946899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:25.947505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:25.953513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:25.954086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:25.954526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:25.955260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:25.955714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:25.956139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:26.092342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:26.100064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fbc186e-ddc3-4cc3-bba6-f0af957d9682 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157042 Sep 19 12:08:26.100620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 678/1319] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:26.349123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:26.349674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:26.356493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:26.357033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:26.357486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:26.358243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:26.358678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:26.359105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:26.493483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:26.501882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ac93fa4-6de5-428e-ac78-ac7dcfce6226 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157234 Sep 19 12:08:26.502710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 642/1320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:26 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:26.552272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:26.554485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:26.560945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:26.561430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:26.561905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:26.562605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:26.563062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:26.563484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:26.593442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f79fe6b-1d04-4212-a8b8-a425d1b2d458 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045840 Sep 19 12:08:26.594022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 679/1321] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:27.124453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:27.125123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:27.131824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:27.132316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:27.132756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:27.133462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:27.134025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:27.134456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:27.267062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:27.275975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7100b2fd-b03c-47d5-b67d-2a135f1d7ad3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156367 Sep 19 12:08:27.276528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 643/1322] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:27.524879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:27.525420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:27.531734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:27.532219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:27.532649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:27.533338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:27.533806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:27.534232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:27.606759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:27.608946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:27.616302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:27.616985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:27.617422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:27.618160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:27.618613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:27.619045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:27.651369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c8dad17-dab7-46e7-a602-baecc1e911d0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049109 Sep 19 12:08:27.653117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 644/1323] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:27.668425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:27.677140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-949f3567-a61e-49f6-9b8e-8e5c34fe5e77 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156243 Sep 19 12:08:27.677707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 680/1324] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:27 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:28.298833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:28.299478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:28.305620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:28.306138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:28.306581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:28.307275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:28.307737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:28.308161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:28.442643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:28.450195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d73e8b7a-6817-4d9c-b893-1b230fedb56d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155274 Sep 19 12:08:28.450758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 645/1325] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:28.663676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:28.666026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:28.672404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:28.672995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:28.673313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:28.674066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:28.674523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:28.674945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:28.700897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:28.701419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:28.705756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa3b0c51-c6d8-4280-b15f-6800c25d7b2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Sep 19 12:08:28.706361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 681/1326] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:28.709003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:28.709493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:28.710204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:28.711184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:28.711649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:28.712091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:28.842727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:28.851164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c32b613-2797-40ba-ae2a-2712371e53ea tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154114 Sep 19 12:08:28.851739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 646/1327] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:28 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:29.475545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:29.476064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:29.482324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:29.482809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:29.483248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:29.483948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:29.484402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:29.484824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:29.619242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:29.627122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9926cf0a-c9e3-41a5-811c-85355f6f3728 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156126 Sep 19 12:08:29.627685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 682/1328] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:29.720625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:29.722790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:29.729878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:29.730474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:29.730729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:29.731420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:29.731873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:29.732289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:29.761349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39824220-da75-4e2d-939f-a5795cc15c4f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Sep 19 12:08:29.761924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 647/1329] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:29.874825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:29.875430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:29.881977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:29.882461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:29.882895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:29.883585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:29.884037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:29.884455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:30.014646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:30.023408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2af45d7a-db2d-4696-bc8b-cad897d0d0a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152442 Sep 19 12:08:30.023972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 683/1330] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:29 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:30.650811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:30.651424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:30.657811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:30.658350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:30.658834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:30.659646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:30.660102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:30.660582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:30.774164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:30.776420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:30.782449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:30.782937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:30.783513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:30.784093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:30.784547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:30.784974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:30.789355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:30.803164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:30.811200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-07959540-f358-45ee-bccb-83fe4bbc3b7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.164213 Sep 19 12:08:30.811805 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 648/1331] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:30.822598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3718dd8b-a4b9-4e1c-b400-10c1098358b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052751 Sep 19 12:08:30.823179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 684/1332] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:31.046732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:31.047427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:31.054207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:31.054691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:31.055135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:31.055831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:31.056285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:31.056711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:31.185623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:31.194035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0ba6c800-b594-479d-9289-2d376683124d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151115 Sep 19 12:08:31.194604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 649/1333] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:31 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:31.835813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:31.837854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:31.838341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:31.838513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:31.845230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:31.845421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:31.845718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:31.845921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:31.846183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:31.846303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:31.846879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:31.846988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:31.847331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:31.847449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:31.847755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:31.847868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:31.878523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75628ce7-eb58-4fa6-b6a8-357b6fcc798c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046878 Sep 19 12:08:31.883662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 685/1334] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:31.976704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:31.978973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:31.985436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69df7e69-44ce-48dc-985b-52174ef2fd26 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151761 Sep 19 12:08:31.986053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 650/1335] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:32.218189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:32.218792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:32.225246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:32.225720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:32.226176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:32.226852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:32.227297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:32.227717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:32.364806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:32.374834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ea23157-32c3-41e4-8df3-5744197e00c5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.160776 Sep 19 12:08:32.375408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 686/1336] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:32 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:32.892183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:32.894430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:32.901736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:32.902246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:32.902698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:32.903399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:32.903850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:32.904268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:32.933116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c3ea33e-410e-47c7-ab1e-2788c552a6e8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045393 Sep 19 12:08:32.933669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 651/1337] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:33.010450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:33.011057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:33.017450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:33.017962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:33.018397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:33.019104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:33.019544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:33.020045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:33.154890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:33.162949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4179a113-fecc-4086-a556-2601939b9233 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156312 Sep 19 12:08:33.163512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 687/1338] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:33.398156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:33.398709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:33.404733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:33.405219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:33.405656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:33.406405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:33.406863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:33.407297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:33.540287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:33.548499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d43557b9-58e4-4046-8df3-dfcb82c1477b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154907 Sep 19 12:08:33.549250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 652/1339] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:33 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:33.946092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:33.948254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:33.954190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:33.954671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:33.955112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:33.955795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:33.956245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:33.956666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:33.986113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73b2b673-408f-406a-af89-6eb1ada8561e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Sep 19 12:08:33.986680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 688/1340] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:34.185723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:34.186373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:34.194180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:34.194679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:34.195118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:34.195832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:34.196293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:34.196725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:34.328439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:34.336152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3372e87-90c7-4e37-955c-2ccd03ae10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154405 Sep 19 12:08:34.336716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 653/1341] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:34 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:34.572509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:34.573096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:34.579570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:34.580074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:34.580522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:34.581202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:34.581663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:34.582107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:34.709791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:34.718354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ff82548-3314-4672-87f4-e88ad6275aad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149673 Sep 19 12:08:34.718940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 689/1342] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:34 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:34.998652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:35.000834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:35.006929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:35.007418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:35.007858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:35.008554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:35.009010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:35.009440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:35.039557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c8bb751-d143-43c3-beda-30373638fd52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Sep 19 12:08:35.040189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 654/1343] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:35.359853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:35.360488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:35.367235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:35.367728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:35.368174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:35.368880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:35.369338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:35.369783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:35.511935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:35.519755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51cf5a08-e84b-4d40-b3c4-ec035824a2f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.164018 Sep 19 12:08:35.520321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 690/1344] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:35.742032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:35.742564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:35.749007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:35.749483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:35.749941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:35.750655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:35.751102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:35.751544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:35.891391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:35.899693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ec8ac40-4d43-4fa5-9809-7f2f64980cb8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.162531 Sep 19 12:08:35.900255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 655/1345] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:35 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:36.053215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:36.055434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:36.061834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:36.062315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:36.062744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:36.063436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:36.063890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:36.064311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:36.094061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b016e56-cc94-4516-bf87-86d0f3594cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 Sep 19 12:08:36.094621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 691/1346] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:36.543825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:36.544436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:36.550560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:36.550983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:36.551420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:36.552190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:36.552647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:36.553076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:36.684463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:36.692844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-73ac55f7-de77-4270-8e8e-884d17331b38 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152411 Sep 19 12:08:36.693409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 656/1347] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:36.922928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:36.923558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:36.929603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:36.930114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:36.930542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:36.931233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:36.931678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:36.932102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:37.066991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:37.076172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fc22d48a-ff31-4c33-a68c-e85ee024b719 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157225 Sep 19 12:08:37.076745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 692/1348] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:36 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:37.106878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:37.109053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:37.115965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:37.116454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:37.116887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:37.117593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:37.118075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:37.118503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:37.148960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e40d866-632f-43e1-a14d-0be011b83e00 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Sep 19 12:08:37.149548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 657/1349] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:37.716900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:37.717504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:37.724257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:37.724737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:37.725162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:37.725877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:37.726326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:37.726741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:37.865049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:37.872772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a33cfe53-9dbb-4875-9a9a-5843d92bb634 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159933 Sep 19 12:08:37.873334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 693/1350] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:38.100240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:38.100978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:38.107170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:38.107717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:38.107961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:38.108669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:38.109126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:38.109656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:38.162371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:38.164557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:38.171431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:38.171920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:38.172357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:38.173471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:38.174019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:38.174591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:38.209204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79cd6b6c-2049-444f-af08-45e0e0e4e53f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052148 Sep 19 12:08:38.210050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 694/1351] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:38.262337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:38.270791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1037a5ab-eea6-4d0f-acb2-3edad979602d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.175034 Sep 19 12:08:38.271364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 658/1352] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:38 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:38.896175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:38.896834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:38.902978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:38.903459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:38.903907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:38.904579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:38.905030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:38.905451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:39.034994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:39.043343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b22673c-d38d-4b73-981e-fe2d0f0efa4b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151606 Sep 19 12:08:39.043919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 695/1353] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:39.220943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:39.223160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:39.229605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:39.230108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:39.230551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:39.231259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:39.231714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:39.232141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:39.261785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-68a0e15e-0f9b-4fbe-a5a1-89ded9b0adb3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Sep 19 12:08:39.262355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 659/1354] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:39.293913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:39.294515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:39.300857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:39.301334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:39.302304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:39.302991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:39.303442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:39.303854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:39.436387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:39.445440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21ba0c14-d9e7-49e7-8fda-541599fe85b4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.155437 Sep 19 12:08:39.446047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 696/1355] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:39 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:40.066252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:40.066856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:40.073402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:40.073913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:40.074350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:40.075043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:40.075495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:40.075926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:40.204061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:40.211892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-02a2ceaa-e787-4b93-ab41-f69528471723 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149496 Sep 19 12:08:40.212458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 660/1356] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:40.275095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:40.277477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:40.283440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:40.283918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:40.284346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:40.285076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:40.285520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:40.285969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:40.319630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a0d642b-a23b-4a53-bf07-c196906c1593 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048950 Sep 19 12:08:40.320344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 697/1357] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:40.468873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:40.469513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:40.476430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:40.476909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:40.477341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:40.478060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:40.478512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:40.478936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:40.611992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:40.621084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3ceee9dd-87df-4d0e-bf70-5755efa05eb5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156510 Sep 19 12:08:40.621651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 661/1358] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:40 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:41.235852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:41.236456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:41.242353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:41.242824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:41.244560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:41.244560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:41.244560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:41.244881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:41.332432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:41.335286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:41.341393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=80 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:41.343852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:41.344343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:41.346924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:41.347940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:41.348395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:41.348845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:41.383179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d4bd2d8-78e3-48dc-963a-138ff6411a0a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054887 Sep 19 12:08:41.383754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 662/1359] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:41.384700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:41.392649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f027e39-f95c-43b8-9dc8-862b49156f0b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160674 Sep 19 12:08:41.393410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 698/1360] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:41.643681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:41.644281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:41.651040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:41.651501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:41.651932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:41.652632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:41.653079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:41.653498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:41.791438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:41.801119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a8c73647-1fd3-4cf9-8e4b-26c50957159a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.161243 Sep 19 12:08:41.801741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 663/1361] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:41 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:42.395515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:42.398023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:42.405792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:42.405792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:42.405792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:42.406437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:42.407075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:42.407530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:42.416253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:42.416866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:42.423824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:42.424311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:42.424749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:42.425453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:42.425936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:42.426857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:42.443919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5d3d9ef-0204-4092-9eb8-14ac7de50fd8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052279 Sep 19 12:08:42.445259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 699/1362] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:42.564788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:42.573073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69c7b492-b399-4486-b30e-40258ef6144b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160626 Sep 19 12:08:42.573636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 664/1363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:42.824301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:42.824901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:42.830792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:42.831276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:42.831710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:42.832402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:42.832908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:42.833326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:42.963521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:42.967225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:42.973608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a0804df-d5cc-4fae-b276-a420a80bef43 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152708 Sep 19 12:08:42.974213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 700/1364] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:42 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:43.456279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:43.459019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:43.465694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:43.466218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:43.466660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:43.467356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:43.467813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:43.468242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:43.497964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eee5ce60-8ba9-46a3-a54a-3f6541371096 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Sep 19 12:08:43.498540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 665/1365] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:43.596286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:43.597025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:43.603756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:43.604241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:43.604675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:43.605369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:43.605861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:43.606287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:43.744444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:43.752325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d075fbed-82dc-48b5-aaeb-663204f61128 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160228 Sep 19 12:08:43.752890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 701/1366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:43.997577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:43.998118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:44.004009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:44.005029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:44.005474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:44.006195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:44.006643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:44.007061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:44.133753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:44.142080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e2cb08f4-a7f6-4eb7-8412-094914cc9a76 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148450 Sep 19 12:08:44.142649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 666/1367] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:43 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:44.510687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:44.512864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:44.519006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:44.519492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:44.519930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:44.520630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:44.521081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:44.521505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:44.552983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bc725fa-d55e-4673-909d-bffbd060810c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046241 Sep 19 12:08:44.553556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 702/1368] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:44.776887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:44.777575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:44.784465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:44.784960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:44.785401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:44.786776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:44.787229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:44.787654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:44.803153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:44.923643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:44.931943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d522d873-ba75-41a8-9aaf-9d0748daca9a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159004 Sep 19 12:08:44.932528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 667/1369] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:45.164502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:45.165107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:45.167413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:45.172790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:45.173282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:45.173723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:45.174445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:45.174904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:45.175335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:45.303913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:45.312279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4770ab4a-72b3-4e83-80d5-1ea3b134096a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151665 Sep 19 12:08:45.312852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 703/1370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:45 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:45.564924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:45.567807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:45.573755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:45.574318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:45.574969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:45.575852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:45.576312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:45.576743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:45.606994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4c00922a-26ad-4873-a9e7-c19df42ae912 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046014 Sep 19 12:08:45.607558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 668/1371] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:45.955843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:45.956452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:45.962412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:45.962889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:45.963313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:45.964000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:45.964712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:45.965133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:46.094490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:46.102595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c233384-c6ab-4b5f-b243-30fdf85a4071 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150666 Sep 19 12:08:46.103157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 704/1372] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:46.336955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:46.337573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:46.344379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:46.344808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:46.345261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:46.346003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:46.346467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:46.346894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:46.486794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:46.495048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e900f29d-bb1f-4b93-a5e8-f69ae7a8fadc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.162543 Sep 19 12:08:46.495621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 669/1373] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:46 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:46.620086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:46.622255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:46.628595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:46.629068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:46.630020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:46.630702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:46.631143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:46.631554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:46.664167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89f1ca87-55f4-466c-966b-45b475cbb742 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048094 Sep 19 12:08:46.664764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 705/1374] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:47.126056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:47.126684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:47.133374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:47.133894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:47.134332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:47.135041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:47.135495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:47.135915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:47.265664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:47.273866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-42e03241-7735-43cd-b515-bb247af422cf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151659 Sep 19 12:08:47.274451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 670/1375] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:47.519006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:47.519612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:47.525534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:47.526047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:47.526485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:47.527176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:47.527628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:47.528049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:47.665399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:47.673680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85d844e8-b8c3-4329-9283-150bb4de76d1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158711 Sep 19 12:08:47.674271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 706/1376] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:47 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:47.677580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:47.679829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:47.686295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:47.686769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:47.687203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:47.687895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:47.688344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:47.688760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:47.720894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b2eb66c0-cea7-4856-b88f-4de2ff5393ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047160 Sep 19 12:08:47.721424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 671/1377] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:48.297668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:48.298321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:48.304757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:48.305244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:48.305682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:48.306402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:48.306860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:48.307292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:48.436135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:48.444521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7c0ec1a-4b94-4af5-9ce1-3fefb2fc616a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150779 Sep 19 12:08:48.445091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 707/1378] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:48.697197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:48.697892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:48.704386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:48.704883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:48.705321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:48.706050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:48.706507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:48.706935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:48.734306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:48.736459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:48.743605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:48.744113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:48.744574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:48.745272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:48.745726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:48.746175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:48.775993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a95efa63-8009-4d99-a7ce-96906e495e3f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045772 Sep 19 12:08:48.776560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 708/1379] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:48.837032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:48.845472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5328e904-8613-4c3d-a0d0-5eff64b20555 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152292 Sep 19 12:08:48.846079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 672/1380] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:48 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:49.467824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:49.468384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:49.474706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:49.475192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:49.475629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:49.476329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:49.476781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:49.477206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:49.609356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:49.617304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7551f555-5ac2-4cec-8ff3-ec812236d99c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153693 Sep 19 12:08:49.617907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 709/1381] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:49.788645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:49.790849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:49.797189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:49.797672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:49.798148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:49.798845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:49.799295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:49.799846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:49.831325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-868d60f5-64ba-4d73-8ce3-e598fea3916f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 Sep 19 12:08:49.831872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 673/1382] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:49.869433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:49.870075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:49.876535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:49.877021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:49.877457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:49.878333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:49.878822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:49.880765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:50.009288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:50.017822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72431ccd-1145-4b4a-a117-29a416bd5ac2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152295 Sep 19 12:08:50.018517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 710/1383] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:49 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:50.640483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:50.641081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:50.647612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:50.648094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:50.648521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:50.649223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:50.649671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:50.650122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:50.789182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:50.797493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c6865afc-572a-4df0-b646-ec7c963fe4c4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160867 Sep 19 12:08:50.798096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 674/1384] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:50.844099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:50.846350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:50.852964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:50.853449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:50.853919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:50.854614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:50.855067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:50.855489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:50.884726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28ecd414-8bec-445b-8fbc-ef8dea5f210c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Sep 19 12:08:50.885417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 711/1385] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:51.042522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:51.043151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:51.049028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:51.049503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:51.050001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:51.050662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:51.051780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:51.052206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:51.186930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:51.195099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2261f889-a7f3-40aa-9b4a-314923df47bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156477 Sep 19 12:08:51.195655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 675/1386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:51 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:51.820284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:51.820879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:51.826848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:51.827322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:51.827749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:51.828544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:51.828994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:51.829411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:51.897679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:51.900033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:51.906497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:51.906941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:51.907381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:51.908089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:51.908575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:51.909004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:51.938920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d08fc7d6-f691-45e4-b17c-84a82b731cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Sep 19 12:08:51.939409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 676/1387] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:51.963055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:51.972403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5779250-3768-427f-8a7a-3fea0401b150 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156452 Sep 19 12:08:51.973002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 712/1388] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:52.218056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:52.218672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:52.224527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:52.225011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:52.225445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:52.226172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:52.226622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:52.227044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:52.353677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:52.362098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86f565cb-51be-42f3-88e6-9c012fd40fd8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148230 Sep 19 12:08:52.362679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 677/1389] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:52 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:52.951343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:52.953530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:52.960478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:52.960991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:52.961425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:52.962160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:52.962617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:52.963042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:52.993293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d3982136-851f-4f70-84ad-1d387b92ea22 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Sep 19 12:08:52.993982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 713/1390] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:52.996313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:52.996926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:53.003494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:53.003972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:53.004482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:53.005743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:53.006449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:53.006875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:53.140420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:53.149167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-995554db-8f70-401e-bdac-6ae964653437 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156479 Sep 19 12:08:53.149381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 678/1391] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:08:53.386432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:53.387043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:53.393039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:53.393524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:53.394193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:53.395282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:53.395768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:53.396195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:53.526271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:53.534644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7c0bfb4-41e4-4c00-9411-5e90f68f718f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152136 Sep 19 12:08:53.535267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 714/1392] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:53 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:54.005232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:54.007426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:54.013971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:54.014454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:54.014880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:54.015571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:54.016017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:54.016432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:54.046322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0630aca1-9533-4eb1-98c8-25e032b567f9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Sep 19 12:08:54.046901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 679/1393] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:54.172577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:54.173191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:54.180315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:54.180810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:54.181471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:54.182752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:54.183626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:54.184392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:54.320320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:54.328184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d45cbc03-dd45-460c-83ca-f77c48db83c5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159431 Sep 19 12:08:54.328765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 715/1394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:54.557433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:54.558070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:54.564044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:54.564575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:54.565163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:54.565892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:54.566349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:54.567324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:54.699074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:54.707461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47a91b7e-edf8-44c4-a4cd-4953a78df28b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153855 Sep 19 12:08:54.708030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 680/1395] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:54 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:55.059638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:55.061863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:55.067917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:55.068397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:55.068832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:55.069520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:55.070005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:55.070426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:55.100413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ff3f0be-5c85-4064-a7f2-96c5f0ccd687 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Sep 19 12:08:55.100994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 716/1396] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:55.352006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:55.352575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:55.359188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:55.359677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:55.360117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:55.360829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:55.361281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:55.361705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:55.499635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:55.507874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ffbea554-237b-492b-bf30-88c4d59dbf19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160370 Sep 19 12:08:55.508445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 681/1397] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:55.731365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:55.731903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:55.738537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:55.739017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:55.739504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:55.740229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:55.740680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:55.741095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:55.759581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:55.871149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:55.880132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5df0fa3-e6cc-4c7b-b33f-8264491e05db tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152122 Sep 19 12:08:55.880714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 717/1398] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:55 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:56.112875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:56.115576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:56.121556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:56.122075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:56.122536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:56.123213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:56.123668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:56.124095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:56.154583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-540df788-4d34-49fe-8dd6-eb4786228b06 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045662 Sep 19 12:08:56.155153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 682/1399] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:56.532331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:56.532937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:56.539390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:56.539872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:56.540314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:56.541007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:56.541520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:56.542012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:56.674566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:56.682538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b528ab66-1dd3-4f0d-b963-cf930cefca72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154532 Sep 19 12:08:56.683377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 718/1400] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:56.902989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:56.903579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:56.910053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:56.911085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:56.911528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:56.912310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:56.912679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:56.913105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:57.040325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:57.048866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-11750a23-1cf4-4f18-9197-a10f51052be0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149731 Sep 19 12:08:57.049476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 683/1401] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:56 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:57.167624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:57.169722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:57.176035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:57.176520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:57.177008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:57.177719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:57.178269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:57.178720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:57.210762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a1f4a3e-26bd-4e53-b4ac-37a149403ce9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Sep 19 12:08:57.211337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 719/1402] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:08:57.705819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:57.706427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:57.713082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:57.713573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:57.714043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:57.715008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:57.715464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:57.715888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:57.718585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:08:57.849274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:57.856952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-986b76e8-a95f-4f31-b611-f326f8a93a80 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155111 Sep 19 12:08:57.857610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 684/1403] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:58.071869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:58.072469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:58.078556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:58.079035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:58.079464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:58.080139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:58.080579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:58.080992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:58.212074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:58.220747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4773e56-6cad-4221-bed8-6c4e67afa862 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152704 Sep 19 12:08:58.221397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 720/1404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:58 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:58.223439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:58.226235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:58.232298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:58.232777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:58.233211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:58.233925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:58.234373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:58.234791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:58.263676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85ba9bcd-deaa-4f49-998f-f0286174de45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Sep 19 12:08:58.264230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 685/1405] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:58.884086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:58.884630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:58.890630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:58.891101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:58.891528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:58.892208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:58.892651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:58.893065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:59.024659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:59.032334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c037d7f9-904d-4afd-b8e9-e7bcd2d1c784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152783 Sep 19 12:08:59.032899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 721/1406] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:08:59.244939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:59.245556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:59.252045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:59.252529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:59.252966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:59.253671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:59.254188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:59.254600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:59.276127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:08:59.278319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:08:59.284615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:59.285095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:59.285521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:59.286801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:08:59.287253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:08:59.287670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:08:59.318502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e0dd3f4-b687-443e-a0f0-844903b3a2a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046302 Sep 19 12:08:59.319066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 722/1407] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:08:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:08:59.391136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:08:59.399474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a5bc4cd-721b-46fb-a465-176868575d5f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158367 Sep 19 12:08:59.399977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 686/1408] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:08:59 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:00.056594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:00.057210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:00.063278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:00.063805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:00.064241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:00.064941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:00.065401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:00.065905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:00.195915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:00.204077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-990d28ea-b824-4c24-b47a-7949b80d9e19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151485 Sep 19 12:09:00.204700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 723/1409] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:00.330920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:00.333073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:00.339734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:00.340215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:00.340655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:00.341371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:00.341854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:00.342275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:00.373158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-151bd1c6-2d72-424a-ac69-2a7e1358fd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046203 Sep 19 12:09:00.373727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 687/1410] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:00.422789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:00.423430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:00.430456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:00.430939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:00.431370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:00.432058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:00.432507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:00.432928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:00.576477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:00.585219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5acb0a65-9fe2-4101-914a-3ae1928bb5f7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.166221 Sep 19 12:09:00.585722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 724/1411] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:00 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:01.229261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:01.229886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:01.235929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:01.236411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:01.236838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:01.237528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:01.238002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:01.238425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:01.367337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:01.375107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e9be5993-782e-4c7e-aeea-ec6db9f6deee tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150417 Sep 19 12:09:01.375665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 688/1412] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:01.386201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:01.388388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:01.394478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:01.394953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:01.395382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:01.396071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:01.397161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:01.397581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:01.428421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d39f7c21-aa8c-4253-8ba4-9960a743d7aa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 Sep 19 12:09:01.429071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 725/1413] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:01.608781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:01.609396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:01.615453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:01.615958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:01.616395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:01.617092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:01.617547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:01.618001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:01.751173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:01.760384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6c8bf38c-de09-4764-9046-aa66e02e4eee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.155462 Sep 19 12:09:01.760950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 689/1414] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:01 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:02.399523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:02.400200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:02.406249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:02.406675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:02.407110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:02.407791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:02.408238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:02.408655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:02.441499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:02.444480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:02.451510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:02.452131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:02.452646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:02.453468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:02.454007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:02.454440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:02.486199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2ff4d7bc-a1d9-4b11-b8b1-2cefb5658e2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048669 Sep 19 12:09:02.487326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 690/1415] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:02.541409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:02.549099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-658b5870-6f8f-4e54-9f8b-60431988a42c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154127 Sep 19 12:09:02.549651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 726/1416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:02.784627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:02.785239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:02.791203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:02.791692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:02.792131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:02.792834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:02.793295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:02.793727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:02.925925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:02.935020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ab573b1-bdd1-42bf-bc06-373eac98e8e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154320 Sep 19 12:09:02.935585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 691/1417] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:02 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:03.498964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:03.501070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:03.508140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:03.508619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:03.509052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:03.509746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:03.510220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:03.510639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:03.539561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fadda298-fae1-43f0-98cb-516791a8bc3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Sep 19 12:09:03.540131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 727/1418] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:03.573057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:03.573665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:03.580922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:03.581397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:03.581853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:03.582545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:03.582994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:03.583414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:03.717953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:03.729096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0bd3d0ff-9943-4ce0-8f2b-0b5992600c64 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159753 Sep 19 12:09:03.729689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 692/1419] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:03.958486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:03.959108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:03.965714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:03.966224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:03.966655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:03.967337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:03.967784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:03.968200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:04.096417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:04.104537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca57c835-5217-45cc-9621-f668e21d461a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149958 Sep 19 12:09:04.105105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 728/1420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:03 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:04.552217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:04.555005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:04.561414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:04.561950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:04.562396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:04.563102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:04.563561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:04.563988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:04.593477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c105f852-24ab-47a5-82ba-98694cc0a302 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Sep 19 12:09:04.594146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 693/1421] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:04.755467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:04.756079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:04.762831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:04.763480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:04.764023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:04.764727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:04.765182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:04.765605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:04.914270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:04.922057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba8fbb78-d1ff-4873-b86b-1559a32e588c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.170696 Sep 19 12:09:04.922623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 729/1422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:05.128471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:05.129091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:05.137014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:05.137566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:05.138121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:05.138946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:05.139423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:05.139875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:05.273741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:05.282274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d7828fc5-861b-4745-b18b-e8f2a074da2c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157730 Sep 19 12:09:05.282852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 694/1423] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:05 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:05.606841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:05.609004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:05.615029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:05.615510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:05.615946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:05.616639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:05.617101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:05.617524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:05.647563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2ca3b26-07e7-4f5e-9b88-c5f1bb8e63c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Sep 19 12:09:05.648796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 730/1424] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:05.945616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:05.946268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:05.952828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:05.953311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:05.953754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:05.954473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:05.954928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:05.955357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:06.092845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:06.100915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0f6275fd-85ee-47f2-a80d-6e4853c5e531 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159787 Sep 19 12:09:06.101487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 695/1425] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:06.304822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:06.305379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:06.311817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:06.312304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:06.312743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:06.313491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:06.313976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:06.314404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:06.443763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:06.451976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cef1b4c3-dbfb-4a0e-a23c-23150dbb5072 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151230 Sep 19 12:09:06.452541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 731/1426] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:06 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:06.662331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:06.664410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:06.670394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:06.670877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:06.671306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:06.671992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:06.672442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:06.672857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:06.706239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b0fd5676-868e-4ed3-a8ab-10420d756048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047924 Sep 19 12:09:06.706806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 696/1427] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:07.124147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:07.124788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:07.131554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:07.132092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:07.133049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:07.133757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:07.134227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:07.134644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:07.270276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:07.277928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92b61ff1-8128-4e1e-8d14-30a35b0cda7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157810 Sep 19 12:09:07.278487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 732/1428] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:07.476659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:07.477184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:07.483521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:07.483999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:07.484428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:07.485115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:07.485563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:07.486006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:07.617264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:07.625406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8de82107-f5e4-4e6a-b0d6-81d9c0398049 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153202 Sep 19 12:09:07.626005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 697/1429] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:07 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:07.724110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:07.726938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:07.733259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:07.733740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:07.734202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:07.734909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:07.735357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:07.735776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:07.767890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4450d18-56ca-403d-a21b-a877c4d3b635 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051927 Sep 19 12:09:07.768445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 733/1430] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:08.300975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:08.301576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:08.308292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:08.308776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:08.309209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:08.309933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:08.310387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:08.310808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:08.440383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:08.448689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09441cfa-351d-45ae-beca-e2a98ff6d928 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151811 Sep 19 12:09:08.449292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 698/1431] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:08.648102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:08.648714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:08.655765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:08.656248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:08.656682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:08.657380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:08.657868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:08.658446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:08.662935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:08.781019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:08.783240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:08.791066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:08.791676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:08.792142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:08.792848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:08.793331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:08.793701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:08.795562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:08.804047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e9f5b22-075e-4218-8189-6e03a46be33b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159822 Sep 19 12:09:08.804630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 734/1432] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:08 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:08.825040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8629609c-206d-42c9-a8e8-d4021dc7a92f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048206 Sep 19 12:09:08.825596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 699/1433] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:09.474106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:09.474621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:09.480701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:09.481177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:09.481605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:09.482327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:09.482772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:09.483190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:09.613232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:09.621621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d8f490a-2bfa-4592-9068-7a696f09c4f2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151521 Sep 19 12:09:09.622210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 735/1434] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:09.827123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:09.827869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:09.835570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:09.836064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:09.836525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:09.837228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:09.837689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:09.837819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:09.838235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:09.840265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:09.847159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:09.847649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:09.848082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:09.848778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:09.849231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:09.849657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:09.880597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d71d37f3-dbcd-4856-9dad-e3db80a01834 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046822 Sep 19 12:09:09.881167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 736/1435] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:09.968756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:09.971055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:09.978809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0a19b512-9311-4c9f-af2b-ed7fca43f726 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.155707 Sep 19 12:09:09.979457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 700/1436] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:09 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:10.644766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:10.645398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:10.652059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:10.652540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:10.652977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:10.653670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:10.654151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:10.654574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:10.787484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:10.795150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9993439-4b76-423d-b0b2-9370ec6b8393 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154250 Sep 19 12:09:10.795711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 737/1437] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:10.892829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:10.895006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:10.901367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:10.901885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:10.902322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:10.903009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:10.903454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:10.903870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:10.932815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c29da92d-0c6b-4c6b-bc22-52b520ac8c94 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Sep 19 12:09:10.933364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 701/1438] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:11.001660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:11.002203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:11.008807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:11.009320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:11.010435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:11.011136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:11.011591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:11.012018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:11.140756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:11.148929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e394ab7-c7f1-45ca-82d0-02493b0b0595 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151212 Sep 19 12:09:11.149490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 738/1439] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:10 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:11.818807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:11.819417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:11.821311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=80 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:11.826790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:11.827306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:11.827745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:11.828440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:11.828896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:11.829321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:11.944968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:11.947187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:11.953537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:11.954066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:11.954502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:11.955222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:11.955677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:11.956103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:11.989264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cfb1a48-4e0f-4ebc-85c6-b677bf0647f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048280 Sep 19 12:09:11.989875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 739/1440] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:12.174025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:12.174655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:12.175888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:12.181191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:12.181680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:12.182215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:12.182918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:12.183376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:12.183801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:12.184131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b1cc7ac-4425-4ac5-a746-c4f4234670e6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.369175 Sep 19 12:09:12.184706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 702/1441] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:12.312814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:12.321027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b50d3fb9-79b8-41c9-8b37-f44f726fa65e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151451 Sep 19 12:09:12.321598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 740/1442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:12 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:13.001987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:13.004122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:13.010552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.011029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.011463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.012151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.012600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.013021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.043385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22f940dd-924f-4b87-9a5c-23e1cb36863c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Sep 19 12:09:13.044116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 703/1443] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:13.207157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:13.207771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:13.217344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.217531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.218242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.218851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.219094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.219537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.345145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:13.345778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:13.351793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.353844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.353844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.353844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.354241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.354362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.366902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:13.375032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1cb3900-0827-42bd-8b24-5b51f8af6fe6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.171721 Sep 19 12:09:13.375606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 741/1444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:13.489070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:13.498715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ea8f140-526b-420c-8229-e957a12036bf tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158418 Sep 19 12:09:13.499448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 704/1445] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:13 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:14.056022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:14.058895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:14.064794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:14.065281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:14.065720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:14.066436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:14.066891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:14.067315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:14.096595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-206a0819-e09b-4fa3-b1cd-bea0a192a0f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Sep 19 12:09:14.097153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 742/1446] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:14.399068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:14.399610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:14.406652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:14.407132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:14.407557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:14.408238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:14.408683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:14.409101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:14.521660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:14.522382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:14.529256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:14.529735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:14.530198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:14.530894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:14.533332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:14.533797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:14.548462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:14.562051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3aac14bc-ce0f-4073-b606-923f82da47a9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.166555 Sep 19 12:09:14.576825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 705/1447] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:14.665801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:14.674670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98bb0b5a-da01-4018-959d-c14eccda55c4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156923 Sep 19 12:09:14.675245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 743/1448] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:14 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:15.109047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:15.111644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:15.117577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.118105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.118548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.119252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.119706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.120137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.150330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c93c7e16-d969-4b7e-834e-09f94e28490a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Sep 19 12:09:15.151552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 706/1449] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:15.586527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:15.587156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:15.589703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=82 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:15.594937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.595412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.595839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.596542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.596986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.597402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.697633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:15.698275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:15.704863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.705198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.705640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.706379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.706833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.707264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.731118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:15.739196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4769c297-dfe9-41cf-b04b-5aeb00ef4e70 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156677 Sep 19 12:09:15.740024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 744/1450] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:15.839993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:15.848198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-938d2c91-b525-436f-be8a-234fd69b4231 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154401 Sep 19 12:09:15.848759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 707/1451] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:15 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:16.163595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:16.165757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:16.172393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.172885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.173320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.174043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.174501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.174924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.204215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-365afdf1-ec26-46e0-a678-6e5da42b940a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Sep 19 12:09:16.204776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 745/1452] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:16.763637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:16.764263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:16.770814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.771299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.771800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.772468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.772915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.773339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.871308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:16.871921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:16.878483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.878970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.879429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.880129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.880579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.881001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.904258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:16.911958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b9eb7f4-894d-4264-ab89-dfc80192573d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152248 Sep 19 12:09:16.912539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 708/1453] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:17.015325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:17.023567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9faf8a13-6ed6-4ab5-b0bc-9ff603212b32 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156219 Sep 19 12:09:17.024161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 746/1454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:16 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:17.217290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:17.219612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:17.225602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:17.226121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:17.226554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:17.227252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:17.227824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:17.228133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:17.260760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-72ad036c-5b80-4aff-a7b1-b0769883bb1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047711 Sep 19 12:09:17.261321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 709/1455] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:17.936235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:17.936848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:17.943268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:17.943752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:17.944189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:17.944883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:17.945341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:17.945791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:18.046593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:18.047381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:18.053514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:18.054111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:18.054618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:18.055382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:18.055910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:18.056340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:18.077320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:18.085359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93fe11c0-e559-4fd0-b2e7-e4a8692de590 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153189 Sep 19 12:09:18.085962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 747/1456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:18.186270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:18.194972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18bf3114-378d-42ec-8641-019ef42cadf7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152153 Sep 19 12:09:18.195555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 710/1457] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:18 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:18.272728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:18.275004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:18.280924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:18.281405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:18.281894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:18.282588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:18.283060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:18.283481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:18.312506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cf708ac-957f-44df-bfb8-3637b4ed9e73 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Sep 19 12:09:18.313059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 748/1458] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:19.110345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:19.110889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:19.117266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.117752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.118223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.118926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.119872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.120298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.218300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:19.219056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:19.225379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.225972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.226411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.228021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.228021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.228021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.259868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:19.270717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-584a3913-a2e3-44b9-b684-cff2cfbfa80d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.163899 Sep 19 12:09:19.271769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 711/1459] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:19.325069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:19.327461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:19.334109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.334609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.335107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.335817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.336271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.336697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.374455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a3786017-6bcc-4eb1-9df4-0a21f15e24ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053686 Sep 19 12:09:19.377798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 712/1460] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:19.377938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:19.386785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91cea17c-3512-4d54-a3c8-66c1a813bb5e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.172683 Sep 19 12:09:19.387601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 749/1461] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:19 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:20.295186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:20.295787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:20.297785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:09:20.299302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:09:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:09:20.311177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:20.311674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:20.313528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:20.313528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:20.313528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:20.313870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:20.386883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:20.389085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:20.395545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:20.396408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:20.396632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:20.397306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:20.397838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:20.398233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:20.425021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:20.431128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f994483-4ae0-4a0f-8a5f-0ade1ec2aa9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048256 Sep 19 12:09:20.431736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 750/1462] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:20.436361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:20.436969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:20.442905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:20.443390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:20.443826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:20.444529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:20.444984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:20.445407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:20.452941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:20.461291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b28032e-7637-4822-a4b6-68781324bf21 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.170498 Sep 19 12:09:20.461988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 713/1463] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:20.583172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:20.592342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4468ee79-2cc8-4711-ad87-fe545d44ae5d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159649 Sep 19 12:09:20.592913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 751/1464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:20 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:21.444259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:21.446608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:21.453835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.454333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.454766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.455481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.455937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.456368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.485774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:21.486330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:21.487455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39781b7d-2b15-419f-abee-2e473ccf24cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047555 Sep 19 12:09:21.488036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 714/1465] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:21.492721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.493201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.493632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.494845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.495295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.495717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.616506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:21.617233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:21.623774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.624336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.624826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.625630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.626099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.626519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.633199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:21.641345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a6ce031-9fb5-419f-99fa-6d4aba6b2394 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159460 Sep 19 12:09:21.641943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 752/1466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:21.763826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:21.771950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f547ef0d-c8ca-4c7d-84bb-ee73bf7a9aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159310 Sep 19 12:09:21.772515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 715/1467] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:21 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:22.500710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:22.502772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:22.511705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.512194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.512634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.513436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.513972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.514545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.544630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f92fdfc-833f-474a-8fab-275394a23169 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048003 Sep 19 12:09:22.545182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 753/1468] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:22.664540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:22.665156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:22.672341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.672829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.673264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.674000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.674456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.674876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.795764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:22.796567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:22.802487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.803079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.803573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.804267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.804710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.805125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.810197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:22.818065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-538bfce3-57c5-4dad-8323-e9a5166eb65d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157364 Sep 19 12:09:22.818638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 716/1469] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:22.936065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:22.944323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50066b66-716e-4b77-a848-e250555846af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153141 Sep 19 12:09:22.944895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 754/1470] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:22 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:23.556702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:23.558888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:23.564809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.565287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.565722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:23.566440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.566892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.567311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:23.580679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:23.597337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de4114c9-c53b-487c-8786-056a4d7d9848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Sep 19 12:09:23.597916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 717/1471] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:23.844422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:23.846347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:23.853203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.853741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.854156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:23.854859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.855313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.855737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:23.967740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:23.968651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:23.975523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.976082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.976581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:23.977338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.977879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.978429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:24.002315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:24.012944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b9ac7fc-4105-4a49-8507-a9878e0a558c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.175393 Sep 19 12:09:24.013721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 755/1472] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:24.118366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:24.126990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8040305-5c86-4842-81bd-e15af3dbaee8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.163888 Sep 19 12:09:24.127786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 718/1473] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:23 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:24.609666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:24.611847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:24.617890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:24.618324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:24.618757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:24.620089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:24.620536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:24.620959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:24.650210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-875452b0-9a22-4ccf-ac7d-584947261438 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Sep 19 12:09:24.650768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 756/1474] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:25.037308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:25.037937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:25.044528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.045006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.045445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.046218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.046673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.047097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.152466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:25.153045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:25.159460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.160322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.160997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.161799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.162324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.162947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.184776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:25.193353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a1a1dc2-177b-449d-b1e2-dfeb61a9fdb3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159769 Sep 19 12:09:25.194086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 719/1475] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:25.307980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:25.317087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63634baa-6289-4d40-8af5-add60c4dcd37 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.168947 Sep 19 12:09:25.317690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 757/1476] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:25 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:25.662862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:25.665049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:25.671863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.672351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.672787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.673490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.673982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.674410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.703877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea3538ff-5a94-443c-a71e-4d62200b9d7d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Sep 19 12:09:25.704480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 720/1477] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:26.218288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:26.218908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:26.225537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.226053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.226494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:26.227193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.227646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.228070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:26.342296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:26.342904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:26.349367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.349885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.350319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:26.351026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.351460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.351875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:26.364538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:26.372381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d6efb4d-0cab-4bc7-93da-ad6dd70e0f11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158114 Sep 19 12:09:26.373057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 758/1478] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:26.480461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:26.488833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d54e2c0-057c-4a5e-80c3-2cb4a86773bd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151606 Sep 19 12:09:26.489399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 721/1479] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:26 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:26.718782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:26.720980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:26.727540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.728063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.728463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:26.729150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.729600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.730049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:26.760682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83a30efa-759c-4940-9688-3edbdc51a8df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Sep 19 12:09:26.761251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 759/1480] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:27.396632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:27.397239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:27.404310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:27.404790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:27.405224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:27.405950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:27.406403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:27.406829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:27.512660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:27.513269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:27.519771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:27.520260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:27.520748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:27.521400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:27.521880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:27.522639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:27.539307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:27.547242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6be410bf-48b4-4abf-8025-af1381a6cb24 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154456 Sep 19 12:09:27.547819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 722/1481] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:27.654106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:27.662277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40db827c-30f7-406a-9845-b471d6141a79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154033 Sep 19 12:09:27.662838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 760/1482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:27 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:27.772516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:27.774613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:27.781251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:27.781734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:27.782214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:27.782915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:27.783365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:27.783790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:27.813317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c5032de-2ef8-4412-8201-c4a8219925ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Sep 19 12:09:27.813912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 723/1483] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:28.570854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:28.571459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:28.578449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.578937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.579358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.580048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.580496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.580920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.673374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:09:28.673575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:09:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:09:28.684981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:28.685591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:28.691467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.691949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.692378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.693073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.693520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.693970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.715322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:28.723157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56f8f524-2327-4cba-afe0-27f6f8ad66b2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156072 Sep 19 12:09:28.723733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 761/1484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:28.826688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:28.826865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:28.828846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:28.834824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.835170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aec16ecb-b4b6-47c0-95ea-3d7f09268ba6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154669 Sep 19 12:09:28.835304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.835741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 724/1485] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:28 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:28.837631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.838370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.838825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.839509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.869352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34352dfd-8a55-4f41-be5a-a6fbc80e21e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046970 Sep 19 12:09:28.869925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 762/1486] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:29.747093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:29.747625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:29.754097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.754583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.755019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.755710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.756160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.756581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.859079 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:29.859893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:29.866219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.866694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.867125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.867816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.868261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.868670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.888304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:29.896153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ab9d5490-b6c2-4640-bba2-fa571a619aaf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153497 Sep 19 12:09:29.896730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 725/1487] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:29.901301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:29.903463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:29.909372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.910166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.910616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.913349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.913929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.914342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.914966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:09:29.915113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments (ip 10.222.0.88) !!! Sep 19 12:09:29.947942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4cf55244-cb77-44c5-bc18-5e651ea5b2db tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050161 Sep 19 12:09:29.948691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 726/1488] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:30.007019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:30.015256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6508324c-387a-4ecf-bf23-7b2a186b7b82 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.160100 Sep 19 12:09:30.015822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 763/1489] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:29 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:30.920152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:30.920826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:30.927163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:30.927660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:30.928097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:30.928795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:30.929251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:30.929677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:30.960272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:30.962456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:30.969596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:30.970179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:30.970619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:30.971315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:30.971764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:30.972175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:31.002216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b6d7a0f-f21d-4ea7-9f08-6dc4d406a5d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045590 Sep 19 12:09:31.002625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 764/1490] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:31.038548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:31.039160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:31.045057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:31.045541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:31.046009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:31.046707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:31.047153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:31.047572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:31.060615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:31.068259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-004a6538-77d6-45f3-9f67-8edc06158e77 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152580 Sep 19 12:09:31.068835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 727/1491] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:31.182483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:31.191023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-907e4bea-d1ee-4f3f-8bc9-2dda6459fb13 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156342 Sep 19 12:09:31.191637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 765/1492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:31 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:32.015082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:32.017285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:32.023764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:32.024249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:32.024684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:32.026095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:32.026549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:32.026971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:32.056052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4c3a1ced-d9dc-425a-89b1-504d9a1d8a42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045010 Sep 19 12:09:32.057241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 728/1493] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:32.092640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:32.093252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:32.099702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:32.100189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:32.100625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:32.101321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:32.101801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:32.102232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:32.214997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:32.215637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:32.221543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:32.222061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:32.222512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:32.223202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:32.223650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:32.224071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:32.236073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:32.243645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2a86727-52b7-4e7b-8173-1c14315972c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155309 Sep 19 12:09:32.244830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 766/1494] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:32.354466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:32.363172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45d6eb52-8d47-463f-bd42-2d596ace7743 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152343 Sep 19 12:09:32.363770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 729/1495] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:32 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:33.069274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:33.071503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:33.077541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:33.078072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:33.078493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:33.079189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:33.079636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:33.080103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:33.101681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:33.115856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f42b576e-3be7-40e7-b43a-242fe76e7fa7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050852 Sep 19 12:09:33.116412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 767/1496] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:33.267580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:33.268221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:33.274665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:33.275153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:33.275591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:33.276294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:33.276748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:33.277177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:33.388972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:33.389687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:33.395688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:33.396236 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:33.396677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:33.397380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:33.397855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:33.398283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:33.416797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:33.425182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-062864a4-a85f-49fd-953d-75872fa5fb3f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.161487 Sep 19 12:09:33.425792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 730/1497] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:33.529745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:33.538023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed8059c2-33f4-432e-88e2-47fe5fc8746b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153834 Sep 19 12:09:33.538592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 768/1498] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:33 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:34.128972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:34.131250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:34.137514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:34.138094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:34.138528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:34.139245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:34.139689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:34.140103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:34.170987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-31cf1042-9973-44cf-814d-6ca857a37c3c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Sep 19 12:09:34.171546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 731/1499] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:34.448836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:34.449444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:34.456137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:34.456702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:34.457133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:34.457854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:34.458304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:34.458728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:34.561375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:34.562097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:34.568548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:34.569114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:34.569613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:34.570335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:34.570786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:34.571219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:34.597127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:34.604913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5ad1859-ad32-469e-9b14-777757ec0ab1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160368 Sep 19 12:09:34.605489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 769/1500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:34 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:34.702251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:34.710397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec54a7d7-554a-42f6-8746-bec9de55b416 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152865 Sep 19 12:09:34.710974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 732/1501] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:34 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:35.183698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:35.185888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:35.192012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:35.192495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:35.192934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:35.193630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:35.194128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:35.194554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:35.224001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-717243d6-4756-498a-91fd-ac1a60f734ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Sep 19 12:09:35.224564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 770/1502] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:35.628019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:35.628608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:35.635187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:35.635673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:35.636134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:35.636825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:35.637278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:35.637706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:35.734422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:35.735038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:35.741640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:35.742162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:35.742609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:35.743312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:35.743767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:35.744191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:35.773547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:35.789181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5dc70a24-9b7c-4936-8241-0d92348f6a2f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.165030 Sep 19 12:09:35.789796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 733/1503] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:35.902900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:35.911160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-face89c3-27fb-4fdb-ad83-e004b1af0a7f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.180899 Sep 19 12:09:35.911732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 771/1504] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:35 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:36.236886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:36.239101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:36.245497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:36.246015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:36.246454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:36.247153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:36.247611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:36.248034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:36.250443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:36.278058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2119f9d8-0aea-41f6-8214-a20d32a014ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Sep 19 12:09:36.278621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 734/1505] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:36.813560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:36.814202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:36.820368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:36.820846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:36.821266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:36.822010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:36.822482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:36.822871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:36.933235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:36.933893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:36.940625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:36.941133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:36.941551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:36.942278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:36.942736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:36.943152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:36.966003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:36.973697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65dc6bf4-d5c2-4878-8b07-b7077f284061 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.164091 Sep 19 12:09:36.974320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 772/1506] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:37.074050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:37.082202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34b231e8-9d8e-439c-9276-8a0f8f499dc4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152776 Sep 19 12:09:37.082769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 735/1507] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:36 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:37.291181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:37.293360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:37.299265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:37.299741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:37.300171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:37.300855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:37.301300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:37.301713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:37.331911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63e44baa-ca28-4996-a7d8-56dd44837843 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Sep 19 12:09:37.332387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 773/1508] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:37.998097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:37.998715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:38.005509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:38.006050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:38.006530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:38.007280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:38.007765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:38.008228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:38.105728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:38.106364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:38.112756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:38.113485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:38.113947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:38.114647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:38.115098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:38.115521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:38.139546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:38.148147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4eab8e28-33a9-4b31-857a-34aff4ed917c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153973 Sep 19 12:09:38.148852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 736/1509] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:38.250499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:38.258517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c073b250-b686-4e92-afd6-36b9f47d391d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156666 Sep 19 12:09:38.259070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 774/1510] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:38 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:38.345100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:38.347340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:38.354104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:38.354600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:38.355039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:38.355802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:38.356265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:38.356688 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:38.387131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db8ced53-3ed8-4675-846b-b6b26a6b9396 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Sep 19 12:09:38.387696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 737/1511] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:39.172516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:39.173219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:39.182108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:39.182601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:39.183040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:39.183745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:39.184200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:39.184626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:39.281742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:39.282374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:39.288724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:39.289220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:39.289643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:39.290365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:39.290812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:39.291230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:39.320029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:39.328605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d109d31c-1ecc-429a-a960-35a7f603cc89 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160323 Sep 19 12:09:39.329344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 775/1512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:39 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:39.399851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:39.402148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:39.408161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:39.408644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:39.409078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:39.409796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:39.410245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:39.411023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:39.420773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:39.429525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b68d9280-e45d-4c51-9267-afce9a14a688 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151505 Sep 19 12:09:39.430325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 738/1513] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:39 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:39.442155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b922903-f321-4283-b85f-08fd84d696bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046221 Sep 19 12:09:39.442710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 776/1514] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:40.352597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:40.353913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:40.360588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:40.361076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:40.361509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:40.362255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:40.362707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:40.363129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:40.452559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:40.453174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:40.459730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:40.460369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:40.461000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:40.461739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:40.462301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:40.462782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:40.517417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:40.525642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f999b81-c37d-4659-a838-8d8ac59db35d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.176967 Sep 19 12:09:40.526352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 739/1515] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:40.531850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:40.533606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:40.539905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:40.541216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:40.541864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:40.542616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:40.543071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:40.543499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:40.573979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eaf695d7-75a2-49b3-b95c-f9cf16a88b2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Sep 19 12:09:40.574584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 740/1516] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:40.606607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:40.614891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-770bd5ed-a938-4492-b1d2-d9fffdb528bc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.166231 Sep 19 12:09:40.615461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 777/1517] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:40 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:41.551292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:41.551940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:41.558454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:41.558942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:41.559415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:41.560112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:41.560564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:41.560991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:41.586416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:41.589065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:41.595950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:41.596362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:41.596800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:41.597495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:41.598026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:41.598454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:41.629553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa5b3d28-1ed5-45d4-b408-51eb52b5da78 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Sep 19 12:09:41.634967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 778/1518] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:41.637757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:41.638393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:41.644229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:41.644714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:41.645162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:41.645903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:41.646417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:41.646842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:41.705077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:41.713613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c75caf1e-2f6f-4543-bf00-9b218322b3ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.166221 Sep 19 12:09:41.714470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 741/1519] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:41.788898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:41.797589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6da54931-ff40-4160-840a-4f027d1b3271 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.163503 Sep 19 12:09:41.798184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 779/1520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:41 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:42.642706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:42.645068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:42.647577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=80 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:42.653127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:42.653612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:42.654075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:42.654797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:42.655231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:42.655652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:42.687099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1687c808-9cf9-4c98-b86b-bcfa8c40e4e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048310 Sep 19 12:09:42.687596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 742/1521] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:42.738580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:42.739393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:42.746358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:42.746848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:42.747569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:42.748734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:42.749549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:42.750016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:42.822370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:42.823104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:42.829234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:42.829826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:42.830630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:42.831462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:42.832732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:42.833247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:42.939425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:42.946017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9340a1d7-c58b-4991-9874-66250270fae3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.211297 Sep 19 12:09:42.946840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 780/1522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:42.993928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:43.002415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fee3a9db-e18f-486a-a408-e5b54fa79270 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.184212 Sep 19 12:09:43.002983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 743/1523] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:42 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:43.699507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:43.701667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:43.707748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:43.708231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:43.708667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:43.709357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:43.709836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:43.710263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:43.740596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8058b7da-c0c0-49ee-9c37-46adddfe6b67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045083 Sep 19 12:09:43.741193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 781/1524] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:43.969748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:43.970387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:43.976770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:43.977323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:43.977687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:43.978994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:43.979455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:43.979881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:44.024498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:44.025277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:44.031868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:44.032353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:44.032790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:44.033488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:44.033979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:44.034408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:44.153609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:44.161719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7324aec0-af07-44f9-afac-f4f1ab110fc4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.195801 Sep 19 12:09:44.162335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 744/1525] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:44.197139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:44.205409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-07a3cef8-b8a7-4df9-8776-eec993f92aa4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.184895 Sep 19 12:09:44.205999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 782/1526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:44 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:44.753462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:44.755855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:44.762454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:44.762941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:44.763383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:44.764083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:44.764547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:44.764968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:44.794245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5a10ce1a-98a2-433a-8bb8-a91f100575c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Sep 19 12:09:44.794797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 745/1527] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:45.186358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:45.187061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:45.193602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:45.194121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:45.194563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:45.195260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:45.195726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:45.196155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:45.228368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:45.228985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:45.235497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:45.235988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:45.236456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:45.237159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:45.237616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:45.238066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:45.384888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:45.392638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f66684f-f03c-4b6f-b4a1-02b58b8d988c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.210250 Sep 19 12:09:45.393198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 783/1528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:45.414348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:45.422518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96a26156-cc4e-4859-948d-4088ec91f83b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.198028 Sep 19 12:09:45.423070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 746/1529] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:45 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:45.806787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:45.808957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:45.810974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=80 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:45.816592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:45.817078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:45.817518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:45.818303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:45.818759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:45.819185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:45.823630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:45.850138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17214b49-d25d-4266-ab21-d1d1ed6203b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047272 Sep 19 12:09:45.850703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 784/1530] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:46.416352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:46.417033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:46.423667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:46.424238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:46.424743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:46.425541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:46.426154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:46.426492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:46.446727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:46.447373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:46.453573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:46.454099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:46.454537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:46.455233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:46.455687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:46.456112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:46.621148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:46.629159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c9d9860b-773b-49b0-ac1a-f04ee8d1be35 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.217191 Sep 19 12:09:46.629913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 747/1531] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:46.632182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:46.640566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da6f731d-3b6f-4811-a25a-9e1757ba1e53 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.197861 Sep 19 12:09:46.641125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 785/1532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:46 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:46.862995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:46.865138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:46.871713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:46.872137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:46.872569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:46.873253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:46.873700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:46.874156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:46.903085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a8e23784-cf63-460d-9ac5-2555d9f33502 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044149 Sep 19 12:09:46.903621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 748/1533] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:47.652400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:47.653012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:47.659516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:47.659999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:47.660434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:47.661173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:47.661613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:47.662062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:47.662974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:47.663617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:47.670040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:47.670551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:47.671006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:47.671735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:47.672216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:47.672669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:47.855304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:47.862963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6af748bf-f375-40a5-84d0-6a280bf57091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.214457 Sep 19 12:09:47.863531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 786/1534] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:47.867084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:47.876151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-411b7d39-b797-4531-ba19-92e962dfc362 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217053 Sep 19 12:09:47.876715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 749/1535] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:47 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:47.915808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:47.917963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:47.923790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:47.924268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:47.924699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:47.925381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:47.925847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:47.926267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:47.954907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe82fbdf-1bff-410a-8f15-00766eddf682 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Sep 19 12:09:47.955476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 787/1536] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:48.886448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:48.887059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:48.894080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:48.894313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:48.894754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:48.895460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:48.895917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:48.896341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:48.900254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:48.901033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:48.907709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:48.908185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:48.908610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:48.909292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:48.909737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:48.910181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:49.089581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:49.091825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:49.092741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:49.098457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30ff77b4-0f42-4c98-829f-2919a93fad72 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.216381 Sep 19 12:09:49.099033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 750/1537] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:49.101299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0fa346f-49aa-48ba-bd03-dbc2eedfb027 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.205965 Sep 19 12:09:49.102035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 788/1538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:48 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:49.103790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:49.105969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:49.111666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:49.112157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:49.112590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:49.113288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:49.113746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:49.114262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:49.145379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a8b3756-1c0d-47e3-b6ff-f9c2b3841dd1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Sep 19 12:09:49.145867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 751/1539] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:50.122577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:50.123190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:50.124736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:50.125383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:50.130273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:50.130755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:50.131193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:50.131977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:50.132221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:50.132429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:50.132708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:50.132850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:50.133145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:50.133876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:50.134504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:50.134737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:50.325822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:50.335148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12bcd179-82f6-4ba1-a1f1-8714b34dd62a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.216111 Sep 19 12:09:50.335148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 789/1540] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:50.338451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:50.339508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:50.341817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:50.347671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:50.348160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:50.348599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:50.348875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-891813a8-692b-4495-8bb7-d7c3f283e17c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.227831 Sep 19 12:09:50.349306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:50.349796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:50.350219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:50.350353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 752/1541] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:50 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:50.382279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-687a426b-e15a-427a-8b73-48f69ee2d416 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Sep 19 12:09:50.382726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 790/1542] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:51.359866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:51.360626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:51.362706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:09:51.362859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:09:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:09:51.372960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:51.373703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:51.376825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:51.377334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:51.377796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:51.378512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:51.378980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:51.379414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:51.380993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:51.381494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:51.382104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:51.382798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:51.383299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:51.384296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:51.580021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:51.583594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:51.587993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8567cd6f-e80b-478d-9650-3d149a0738da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.232068 Sep 19 12:09:51.588572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 753/1543] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:51.592393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57a27109-3aa5-4038-b209-8287d640e32a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.223433 Sep 19 12:09:51.593225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 791/1544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:51 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:51.593365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:51.595489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:51.601103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:51.601578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:51.602038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:51.603213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:51.603656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:51.604071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:51.633513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f9539cd-ab3c-4a0a-bdde-ffcc0a7178dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Sep 19 12:09:51.634240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 754/1545] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:52.612566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:52.613272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:52.615685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:52.616308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:52.620099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:52.620594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:52.621034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:52.621746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:52.622235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:52.622661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:52.626574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:52.627190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:52.627605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:52.628323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:52.628775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:52.629199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:52.828037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:52.835031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:52.835967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f0abe31-903d-4625-b418-3f038b4ba905 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.227567 Sep 19 12:09:52.836542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 792/1546] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:52.841809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:52.843622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:52.844053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48fb91ef-2e6d-4a05-bb43-fbb8eb37feab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.232209 Sep 19 12:09:52.844712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 755/1547] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:52 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:52.856622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:52.857130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:52.857562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:52.858350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:52.858797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:52.859213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:52.889148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-218c3f56-98ab-4051-b3f2-59e653c452bf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051623 Sep 19 12:09:52.889700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 793/1548] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:53.858706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:53.859321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:53.865731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:53.866249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:53.866569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:53.866966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:53.867177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:53.867370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:53.867826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:53.868271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:53.873728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:53.874239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:53.874671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:53.875361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:53.875808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:53.876228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:54.058280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:54.062157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:54.066039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e97281ae-9d06-472b-8660-816f6f92a217 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.211101 Sep 19 12:09:54.066610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 756/1549] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:54.070821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1028a1e-dfbc-44df-a306-c99346313200 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.208039 Sep 19 12:09:54.071665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:54.075323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 794/1550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:53 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:54.075495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:54.079609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:54.080289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:54.080730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:54.081439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:54.081912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:54.082338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:54.111602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fcc24d82-d0a0-41ce-b0c2-db4df1721e2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Sep 19 12:09:54.112143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 757/1551] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:55.090774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:55.091390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:55.094211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:55.094825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:55.097912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:55.098400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:55.098839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:55.099649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:55.100109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:55.100535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:55.101220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:55.101699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:55.102163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:55.102873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:55.103329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:55.104373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:55.297247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:55.301217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:55.305216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e537ca3-f1a9-4cbf-9ac8-dcabc1dc5d76 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.219235 Sep 19 12:09:55.306026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 795/1552] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:55.309552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22b848b8-5d68-4311-aa30-7d8f72a6d5ee tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.219003 Sep 19 12:09:55.310332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 758/1553] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:55 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:55.311775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:55.313952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:55.319725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:55.320206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:55.320636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:55.321318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:55.321771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:55.322691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:55.351732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a44f431f-9d26-44a5-aeec-29fd93232f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Sep 19 12:09:55.352278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 796/1554] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:56.328616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:56.329231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:56.332182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:56.332795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:56.335833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:56.336322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:56.336763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:56.337465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:56.338004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:56.338435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:56.339360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:56.339845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:56.340281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:56.340976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:56.341420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:56.341872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:56.742149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:56.745733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:56.750455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-44840a4d-1f80-4fc3-9bf2-fafdb3c35e48 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.425738 Sep 19 12:09:56.751034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 759/1555] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:56.753966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d8f9e6a-98c4-466c-9323-978e574858c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.425605 Sep 19 12:09:56.754683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 797/1556] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:56 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:56.756143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:56.758357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:56.764948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:56.765608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:56.766087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:56.766841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:56.767298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:56.767726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:56.797034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fc8bf97d-34a3-4266-b549-b82a10e4d026 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Sep 19 12:09:56.797580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 760/1557] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:57.774616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:57.775381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:57.776139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:57.776740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:57.781955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:57.782440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:57.782873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:57.783068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:57.783545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:57.783667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:57.783974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:57.784086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:57.784409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:57.784653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:57.785096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:57.785519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:57.981143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:57.984695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:57.989523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-485f887b-66bc-4dcc-9b7b-e36714210a6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217197 Sep 19 12:09:57.990123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 761/1558] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:57 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:57.994750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:57.996903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:57.997063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6154fd6b-9b97-410a-bbbb-bfd0c257738e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.226141 Sep 19 12:09:57.997904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 798/1559] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:58.003373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:58.003828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:58.004267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:58.004965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:58.005418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:58.005871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:58.036460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fc7cba15-3b66-485b-a545-1d898da9f04b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Sep 19 12:09:58.037017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 762/1560] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:59.012316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:59.012845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:59.015410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:09:59.015573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 (ip 10.222.0.88) !!! Sep 19 12:09:59.019846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:59.020590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:59.021093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:59.021579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:59.022038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:59.022736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:59.023187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:59.023610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:59.026920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:59.027414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:59.027859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:59.028670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:59.029017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:59.029434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:59.223522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:59.227248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:59.232237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ade2059-d640-43b2-b354-eccd8273faba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.223829 Sep 19 12:09:59.232798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 799/1561] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:59 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:59.235596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb9a7172-d341-43d2-8af8-9a3607a75793 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.219544 Sep 19 12:09:59.236313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 763/1562] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:09:59.237976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:59.239859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:59.246779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:59.247257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:59.247691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:59.248381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:59.248839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:59.249312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:59.273614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:59.278709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b0ec55f-72af-4d14-b4ed-9efe82e1687c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Sep 19 12:09:59.279258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 800/1563] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:09:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:00.256645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:00.257262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:00.258935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:00.260296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:00.264406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:00.264898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:00.265340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:00.266084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:00.266544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:00.266722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:00.266972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:00.267202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:00.267633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:00.268322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:00.268776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:00.269202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:00.460811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:00.465904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:00.469614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-817a4783-d4dc-4dcf-8354-62877302ed9d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.216755 Sep 19 12:10:00.470222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 764/1564] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:00 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:00.474904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:00.476469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b57ca78d-8e78-4148-ace5-4fb446dce345 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.221236 Sep 19 12:10:00.477035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:00.484078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 801/1565] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:00.484239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:00.484239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:00.484556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:00.485255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:00.485713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:00.486161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:00.515238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5d6d3445-f986-4c67-9355-7ae5d1d04bb9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Sep 19 12:10:00.515787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 765/1566] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:01.493093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:01.493630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:01.499801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:01.499941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:01.500348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:01.500492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:01.500705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:01.501397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:01.501906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:01.502338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:01.506822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:01.507284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:01.507721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:01.508436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:01.508882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:01.509299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:01.693634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:01.702712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:01.702895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64b02c51-22ac-41e4-9b39-650a8acd9e7e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.213697 Sep 19 12:10:01.703638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 802/1567] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:01 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:01.708693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:01.710642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c78eb270-2405-4bef-a8e3-17fcfc76c470 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.214468 Sep 19 12:10:01.711508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 766/1568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:01.711639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:01.717938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:01.718553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:01.719027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:01.719788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:01.720271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:01.720743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:01.750308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f213c228-5125-419d-8e14-becffc3cedbe tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Sep 19 12:10:01.750862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 803/1569] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:02.726339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:02.726955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:02.734762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:02.735369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:02.735628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:02.736000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:02.736448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:02.737137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:02.737590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:02.738081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:02.741895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:02.742382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:02.742814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:02.743541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:02.744036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:02.744461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:02.752896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:02.934155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:02.938909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:02.942294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4081474-fa57-459a-9a73-c611c98cb631 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.220085 Sep 19 12:10:02.942862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 767/1570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:02 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:02.946627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35d8f3dd-b18a-416e-a521-ebffeceaedf0 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.215889 Sep 19 12:10:02.947841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 804/1571] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:02.947979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:02.950005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:02.955804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:02.956283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:02.956712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:02.957398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:02.957891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:02.958313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:02.987267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30b338b0-4bdf-417c-989e-c1e5978b8634 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 Sep 19 12:10:02.987748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 768/1572] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:03.968735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:03.969344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:03.971260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:03.971969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:03.976006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:03.976492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:03.976930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:03.977632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:03.978164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:03.978863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:03.979122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:03.979333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:03.979766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:03.980457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:03.980907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:03.981439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:04.176879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:04.181323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:04.185502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0d368b4-aa89-4819-acba-9ed61ff53b4b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.221148 Sep 19 12:10:04.186191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 805/1573] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:03 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:04.189342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2028dfb7-d8bf-49ab-8114-26ab6e7c0461 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.222187 Sep 19 12:10:04.189938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 769/1574] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:04.190639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:04.192854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:04.198756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:04.199266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:04.199699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:04.200384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:04.200839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:04.201257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:04.233657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-048d87c9-a63f-4f6e-8841-1e3de69403bb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046514 Sep 19 12:10:04.234181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 806/1575] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:05.207841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:05.208458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:05.212804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:05.213411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:05.215419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:05.215910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:05.216347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:05.217056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:05.217542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:05.218149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:05.219972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:05.220458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:05.220894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:05.221591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:05.222069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:05.222498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:05.408942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:05.417736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:05.418273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2ece7620-7d3b-41b3-b7a6-678682cd26f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.214361 Sep 19 12:10:05.419093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 770/1576] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:05 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:05.423564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:05.425689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:05.425953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-637be20a-50bd-4197-b935-e1bdb45973aa tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.216769 Sep 19 12:10:05.426785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 807/1577] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:05.432351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:05.432351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:05.432602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:05.433288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:05.433900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:05.434329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:05.464596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c117b34c-8d45-47b2-b5e6-13100b251e3a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Sep 19 12:10:05.465192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 771/1578] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:06.440377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:06.440908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:06.447383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:06.447862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:06.448291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:06.449180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:06.449599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:06.449899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:06.450052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:06.450472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:06.456455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:06.456935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:06.457370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:06.458522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:06.458936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:06.459168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:06.640466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:06.648619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-356e2b99-f90d-4a22-87c8-45557ddeec93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.212109 Sep 19 12:10:06.649400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 808/1579] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:06 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:06.654732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:06.654918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:06.656760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:06.662650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86d7007e-143c-48f6-b6cf-152eaee6dbbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218135 Sep 19 12:10:06.662869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:06.663363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 772/1580] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:06.663767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:06.664210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:06.664913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:06.665371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:06.665817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:06.695969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d345e2a-10c2-45bf-a48b-0fcd2834fc45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Sep 19 12:10:06.696636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 809/1581] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:07.672855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:07.673485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:07.679885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:07.680438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:07.680977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:07.681649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:07.682139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:07.682623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:07.686113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:07.686739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:07.693037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:07.693519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:07.693986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:07.694677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:07.695130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:07.695549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:07.892548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:07.896766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:07.901150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63afe342-b86a-4629-a51c-38d71d79cc93 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.232328 Sep 19 12:10:07.902259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 773/1582] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:07 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:07.904931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a4ad24e-4000-4e9d-97a6-9e3c5cfbd04c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.222667 Sep 19 12:10:07.905484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 810/1583] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:07.907262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:07.909392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:07.915212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:07.915693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:07.916137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:07.916825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:07.918099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:07.918526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:07.946769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dc7747f7-813e-40be-861e-f3d948ee5cb5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Sep 19 12:10:07.947310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 774/1584] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:08.924483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:08.925036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:08.928396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:08.929009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:08.931964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:08.932485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:08.933504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:08.934229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:08.934690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:08.935116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:08.936210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:08.936697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:08.937138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:08.937908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:08.938431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:08.938857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:09.128905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:09.133415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:09.138210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08abba7e-fef9-4d1d-8dd6-5a52278b9e56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217620 Sep 19 12:10:09.148498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 811/1585] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:08 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:09.148722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9332604-3bb7-4902-8a5f-4e795a42dd15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.216727 Sep 19 12:10:09.148836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:09.148836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:09.148999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 775/1586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:09.152641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:09.153129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:09.153566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:09.154288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:09.154928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:09.155354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:09.185110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77cde652-5f9f-4385-a24a-aed79dcb6a96 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Sep 19 12:10:09.185595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 812/1587] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:10.162021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:10.162723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:10.164725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:10.165345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:10.169149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:10.169635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:10.170185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:10.170903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:10.171354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:10.171782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:10.171887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:10.172305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:10.172735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:10.173425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:10.173903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:10.174328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:10.359607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:10.367878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5099f9e-fe37-4666-b8d3-3b2a1a3f1bd1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.209744 Sep 19 12:10:10.368433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:10.368592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 776/1588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:10 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:10.373585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:10.375729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:10.377697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8caa9dc9-88d4-4a8d-951b-319aa609d510 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.217108 Sep 19 12:10:10.378632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 813/1589] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:10.386928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:10.387412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:10.387849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:10.388551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:10.389155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:10.389581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:10.419717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8280ee4d-5c9e-4fda-bcec-2b17a8a276d6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050256 Sep 19 12:10:10.420281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 777/1590] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:11.391978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:11.392578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:11.399218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:11.399642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:11.400077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:11.400196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:11.400772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:11.400880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:11.401225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:11.401685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:11.407410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:11.407894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:11.408342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:11.409020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:11.409468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:11.409921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:11.597983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:11.602491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:11.606268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65357dbb-4e43-4f65-84a4-8396f6f4de75 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.218187 Sep 19 12:10:11.606832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 814/1591] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:11 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:11.611371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:11.611626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0593eea-3aed-4ec0-8c75-23ea1471bc58 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.215156 Sep 19 12:10:11.612302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 778/1592] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:11.613499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:11.619126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:11.619602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:11.620026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:11.621196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:11.621640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:11.622075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:11.651918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67ce8231-2940-43e5-a786-bc0243e989dd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Sep 19 12:10:11.652389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 815/1593] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:12.629282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:12.630527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:12.635095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:12.635702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:12.637414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:12.637937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:12.638396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:12.639076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:12.639525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:12.639946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:12.642677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:12.643157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:12.643588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:12.644278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:12.644731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:12.645153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:12.834877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:12.838535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:12.843827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-110ce2a8-0310-41a5-956d-13ebe32665ba tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.218029 Sep 19 12:10:12.844012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 779/1594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:12 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:12.846605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6304f63b-63ea-46ef-828b-730a47f0a90f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.215430 Sep 19 12:10:12.847166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 816/1595] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:12.854389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:12.857623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:12.859572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=76 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:12.865240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:12.865810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:12.866325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:12.867029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:12.867547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:12.867967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:12.899443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5881ca4a-cec2-4ec4-8601-2b6771e4afad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050012 Sep 19 12:10:12.900002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 780/1596] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:13.866688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:13.867251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:13.870325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:13.871071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:13.874125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:13.874621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:13.875053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:13.875773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:13.876229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:13.876655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:13.878604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:13.879101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:13.879541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:13.880250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:13.880706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:13.881130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:13.897263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:14.088378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:14.098522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:14.100405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f540cd43-b981-4abb-9f11-9b05d98fe5ad tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.237700 Sep 19 12:10:14.101004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 817/1597] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:13 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:14.105737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:14.107105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-661a04a3-5ae9-449f-8aed-f835744926c6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.240653 Sep 19 12:10:14.107840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 781/1598] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:14.107977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:14.114192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:14.114530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:14.114973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:14.115677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:14.116132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:14.116564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:14.150852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7fe2b91c-5cc9-4464-aa3e-7984afc6f442 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048794 Sep 19 12:10:14.151461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 818/1599] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:15.124347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:15.124957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:15.131347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:15.131837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:15.132254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:15.132742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:15.132966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:15.133086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:15.133421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:15.133898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:15.139825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:15.140311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:15.140745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:15.141448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:15.141946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:15.142377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:15.328998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:15.337166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b1f97fc4-9873-4c06-8b41-b193031b5a2d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.216801 Sep 19 12:10:15.337594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:15.343304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 782/1600] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:15 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:15.343304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:15.345161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:15.346076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c71f2076-1ff8-4547-8412-e6a1ffaa99e9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.217796 Sep 19 12:10:15.346788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 819/1601] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:15.350950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:15.351466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:15.351901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:15.352775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:15.353229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:15.353657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:15.382584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-738860a7-6e2b-403b-9d65-1b05a93c7c61 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043654 Sep 19 12:10:15.383135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 783/1602] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:16.367947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:16.368562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:16.372556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=72 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:16.372871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:16.375488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:16.376327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:16.376810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:16.377247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:16.378055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:16.378509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:16.378931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:16.381934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:16.382420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:16.382883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:16.383635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:16.384098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:16.384523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:16.389746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:16.576830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:16.580582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:16.585149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1415debc-7019-40b5-9bb0-f29e2fdd49af tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.222396 Sep 19 12:10:16.585663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 820/1603] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:16 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:16.588397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a702edfe-cc3a-4b23-ad84-428a9f6b9058 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.222179 Sep 19 12:10:16.588955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 784/1604] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:16.590982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:16.593108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:16.598858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:16.599340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:16.599772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:16.600460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:16.600907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:16.601328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:16.632253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45a14080-33c1-49b4-89bd-df5ccdffef34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045569 Sep 19 12:10:16.632807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 821/1605] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:17.608772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:17.609489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:17.613447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:17.614099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:17.616038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:17.616524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:17.616961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:17.617658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:17.618137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:17.618559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:17.620964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:17.621571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:17.622036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:17.622759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:17.623212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:17.623634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:17.824080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:17.831127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:17.832377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f5e5ebb-bf86-44d5-9975-7a6f34ce5d2a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.227481 Sep 19 12:10:17.845841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 785/1606] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:17 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:17.845841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:17.846154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55bd1daf-5fee-457a-8c5c-4cac1ba8f263 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.230351 Sep 19 12:10:17.846255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:17.846383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 822/1607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:17.846477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:17.846477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:17.846790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:17.847406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:17.848056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:17.848337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:17.878861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ba8016e1-2c88-4628-98ff-57515771afe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Sep 19 12:10:17.879450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 786/1608] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:18.855798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:18.856416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:18.862960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:18.863443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:18.863699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:18.864123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:18.864311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:18.864555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:18.865006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:18.865432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:18.871340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:18.871854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:18.872290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:18.873013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:18.873470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:18.873954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:19.061140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:19.065574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:19.069421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d65f8826-4b50-42b4-8a29-12fb40577afc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217444 Sep 19 12:10:19.070056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 823/1609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:18 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:19.073479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b87aafce-5e6a-43b0-8ae9-7f494fc8a490 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.213515 Sep 19 12:10:19.074804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 787/1610] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:19.075139 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:19.077271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:19.083150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:19.083618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:19.084050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:19.084751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:19.085193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:19.085627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:19.114602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17539376-f0a9-4b22-99a7-1263d66ba05d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Sep 19 12:10:19.115080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 824/1611] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:20.095866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:20.096479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:20.097510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:20.098153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:20.102703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:20.103200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:20.103646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:20.104351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:20.104810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:20.104967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:20.105236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:20.105385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:20.105839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:20.106532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:20.107010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:20.107431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:20.299837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:20.304563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:20.309482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a726120-40fc-4de8-b7f3-9716442787aa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217396 Sep 19 12:10:20.310088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 788/1612] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:20 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:20.313986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20cd8415-9c42-4ea6-8d71-ef55e01fd654 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.220447 Sep 19 12:10:20.314760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 825/1613] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:20.315500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:20.318285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:20.325446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:20.326099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:20.326543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:20.327245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:20.327699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:20.328125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:20.356896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-284d0faf-0dc7-4848-8e88-f4521966be2f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Sep 19 12:10:20.357459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 789/1614] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:21.335020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:21.335745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:21.337750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:21.338484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:21.343243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:21.343724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:21.344149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:21.344847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:21.345292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:21.345532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:21.345709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:21.346057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:21.346498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:21.347203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:21.347663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:21.348091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:21.539516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:21.544054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:21.547909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1ed97a0-6652-464a-87c4-46f7d6e4bc25 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.218271 Sep 19 12:10:21.548483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 826/1615] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:21 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:21.551692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b7e583c1-8786-4d21-bae1-f998676b10ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218204 Sep 19 12:10:21.552248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 790/1616] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:21.553026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:21.555353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:21.561122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:21.561731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:21.562386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:21.563075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:21.563558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:21.564032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:21.594174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ceea67c0-ef68-41b4-81bd-8992ba2bce92 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Sep 19 12:10:21.594720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 827/1617] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:22.571085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:22.571826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:22.574613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:22.575220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:22.578309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:22.578796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:22.579237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:22.579964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:22.580399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:22.580831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:22.581421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:22.581933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:22.582366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:22.583084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:22.583645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:22.584069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:22.769830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:22.779132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:22.780268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9e50be6-a8be-4b42-a6b8-c79b3e8a0f8f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.212814 Sep 19 12:10:22.780918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 791/1618] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:22 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:22.787063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:22.788226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3ab04d8-79bc-4bfa-9eeb-5d0424b7a0fe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.217488 Sep 19 12:10:22.789051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 828/1619] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:22.789243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:22.795463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:22.795954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:22.796395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:22.797101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:22.797559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:22.798011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:22.828125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a4dcce12-b00b-4881-a75f-efc3406c0fc6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Sep 19 12:10:22.828674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 792/1620] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:23.805129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:23.805735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:23.812277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:23.812886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:23.813135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:23.813624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:23.814096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:23.814802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:23.815261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:23.815687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:23.819342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:23.819816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:23.820246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:23.820931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:23.821376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:23.821817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:24.005708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:24.014339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f34b2cc2-2e41-47af-951a-92171d0297e6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.213193 Sep 19 12:10:24.014777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:24.014912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 829/1621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:23 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:24.019456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:24.021574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:24.022594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4848e76-adc7-425b-a389-45a7216ed88b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.214092 Sep 19 12:10:24.023154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 793/1622] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:24.027268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:24.028426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:24.028851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:24.029729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:24.030200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:24.030617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:24.059601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef48968d-70c4-4410-9e88-96f380776471 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 Sep 19 12:10:24.060072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 830/1623] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:25.038420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:25.039037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:25.046088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:25.046578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:25.046692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:25.046810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:25.047072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:25.047770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:25.048226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:25.048653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:25.052988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:25.053477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:25.053954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:25.054788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:25.055276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:25.055698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:25.448959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:25.455317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:25.458059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad189d36-1008-45d0-ae78-d442b58f7310 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.423456 Sep 19 12:10:25.458898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 794/1624] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:25 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:25.463527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a76be29e-db26-4c10-9ae5-8737f89fbc15 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.422103 Sep 19 12:10:25.463667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:25.464592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 831/1625] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:25.466567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:25.472676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:25.473422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:25.474118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:25.476040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:25.476634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:25.477158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:25.506734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-54eb75ea-9ec0-47a3-a259-a1a2594dd9de tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Sep 19 12:10:25.511184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 795/1626] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:26.482785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:26.483372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:26.487234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:26.487838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:26.489696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:26.490266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:26.490696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:26.491394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:26.491852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:26.492267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:26.494005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:26.494481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:26.494913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:26.495601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:26.496052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:26.496472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:26.674488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:26.682762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aeab5daa-d45b-44be-b543-b2b7b59cd15c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.204503 Sep 19 12:10:26.683329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 832/1627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:26 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:26.690055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:26.700933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:26.701789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22b8354c-5db8-4d4b-8e3c-ae842d2e16c7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218285 Sep 19 12:10:26.702480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 796/1628] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:26.703921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:26.709277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:26.709774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:26.710231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:26.710927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:26.711498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:26.711923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:26.741130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8de38ba-d8e7-41e2-a983-55da25bed4bd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056572 Sep 19 12:10:26.741646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 833/1629] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:27.706270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:27.707014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:27.712763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:27.713245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:27.713676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:27.714680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:27.715140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:27.715562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:27.733052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:27.734392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:27.740714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:27.741213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:27.741664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:27.742359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:27.742823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:27.743241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:27.748045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:27.904546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:27.912750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50cef905-c3a4-4915-80ab-70c0b5afd405 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.210835 Sep 19 12:10:27.913323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 797/1630] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:27 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:27.917883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:27.920568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:27.922966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:27.926492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:27.926983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:27.927453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:27.928212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:27.928613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:27.929039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:27.931293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6f709f8-d89b-4f61-93a7-e9531375de47 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.209742 Sep 19 12:10:27.931851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 834/1631] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:27.957538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef050198-99d0-435b-9bab-079b1426e871 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Sep 19 12:10:27.958136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 798/1632] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:28.937230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:28.937855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:28.944098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:28.944570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:28.944996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:28.945677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:28.946150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:28.946569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:28.954062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:28.954677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:28.960665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:28.961155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:28.961592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:28.962322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:28.962776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:28.963206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:29.145669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:29.151109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:29.154048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8fc736cd-947f-4bdb-a691-4063e92b5536 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.221153 Sep 19 12:10:29.154612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 835/1633] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:28 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:29.159129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:29.161232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:29.162266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08fc5c10-77ed-422c-9454-0f15689f1c2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.211998 Sep 19 12:10:29.162978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 799/1634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:29.166982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:29.167460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:29.167884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:29.169062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:29.169505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:29.169965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:29.200403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e6df38a-e5c1-4fc5-a3b7-663b1bd7abda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Sep 19 12:10:29.200957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 836/1635] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:30.177860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:30.178467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:30.185583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:30.186104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:30.186547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:30.186782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:30.187251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:30.187395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:30.187705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:30.188131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:30.193838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:30.194320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:30.194758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:30.195451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:30.195903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:30.196328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:30.380332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:30.382591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:30.385321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:30.390573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-217b8fe6-fdfd-4800-917f-85bc43beb7fd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.216568 Sep 19 12:10:30.391155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 800/1636] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:30 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:30.395785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:30.397994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:30.401275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1ca790d-c8c5-4c02-a78e-c6a2089c6aac tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218768 Sep 19 12:10:30.402103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 837/1637] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:30.404460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:30.404952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:30.405392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:30.406124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:30.406576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:30.407003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:30.438505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3df05286-4192-44d6-84ff-f8ac3db6844c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Sep 19 12:10:30.439053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 801/1638] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:31.413712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:31.414272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:31.420810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:31.421291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:31.421723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:31.422432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:31.422883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:31.423305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:31.424353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:31.424968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:31.431284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:31.431766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:31.432203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:31.432932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:31.433385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:31.433832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:31.615738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:31.622996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:31.625152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bee60376-b17d-4b93-9e87-254e7128be8a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.215302 Sep 19 12:10:31.626640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 838/1639] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:31 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:31.630822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:31.633033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:31.633433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0ccbb1e-13cf-470c-a1b9-432475b5a380 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.212953 Sep 19 12:10:31.637613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 802/1640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:31.640021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:31.640505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:31.640938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:31.641630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:31.642109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:31.642523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:31.671495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee5accf6-0180-43cf-9bf4-d69eca3a1913 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Sep 19 12:10:31.672075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 839/1641] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:32.648796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:32.649405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:32.656338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:32.656759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:32.657194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:32.657303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:32.657562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:32.657997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:32.658450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:32.658875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:32.664094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:32.664572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:32.665001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:32.665713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:32.666261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:32.666679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:32.853826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:32.857379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:32.861994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dbfeceab-3a61-4f82-8306-a59a4c73ba56 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217010 Sep 19 12:10:32.862570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 803/1642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:32 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:32.865322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19887be1-c95b-4adc-9188-e6b74b81e0da tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.212901 Sep 19 12:10:32.866047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 840/1643] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:32.867133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:32.869381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:32.875124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:32.875612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:32.876046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:32.876732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:32.877183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:32.877638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:32.907073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc2209cf-54b0-4239-af30-2cddb3d9dd9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Sep 19 12:10:32.907547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 804/1644] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:33.884474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:33.885088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:33.888374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:33.888977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:33.891873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:33.892356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:33.892796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:33.893491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:33.893979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:33.894406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:33.895334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:33.895809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:33.896237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:33.896919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:33.897361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:33.897788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:34.081246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:34.090427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:34.090617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6d7d794-2ef2-4281-84a3-0036c7668f06 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.209420 Sep 19 12:10:34.091120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 841/1645] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:33 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:34.095802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:34.097970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:34.098707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-458b23cd-7b0f-49fa-a5e7-b8d07d0f7cb9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.214156 Sep 19 12:10:34.099425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 805/1646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:34.103768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:34.104255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:34.104690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:34.106050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:34.106510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:34.106932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:34.135753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-392515a0-8bd9-45ef-ba65-5fd74a9099c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Sep 19 12:10:34.136297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 842/1647] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:35.112983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:35.113603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:35.121719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:35.122313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:35.122749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:35.123415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:35.123890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:35.124268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:35.134807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:35.135421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:35.141781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:35.146835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:35.147283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:35.148004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:35.148610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:35.148862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:35.323320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:35.331425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7744a54d-a803-4482-afb5-1b2433e7fbed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.222342 Sep 19 12:10:35.331856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:35.332013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 806/1648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:35 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:35.336580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:35.338938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:35.340798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b0c7fd4-654c-4a2c-9c3f-58f90c0721b5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.219735 Sep 19 12:10:35.342129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 843/1649] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:35.345569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:35.346081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:35.346515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:35.347212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:35.347660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:35.348081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:35.376685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea353303-f74d-4e8a-890c-2c9a7c141a3b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Sep 19 12:10:35.377225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 807/1650] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:36.355195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:36.356434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:36.362840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:36.363314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:36.363738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:36.364419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:36.364862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:36.365057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:36.365484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:36.365754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:36.372126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:36.372604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:36.373039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:36.373734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:36.374232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:36.374641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:36.568026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:36.572549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:36.577788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30cc0e61-c452-4afc-a196-7f72788f11f5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.226301 Sep 19 12:10:36.578393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 844/1651] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:36 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:36.581665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29d55bab-1757-4c2e-930b-31a45eab1a96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.220379 Sep 19 12:10:36.585527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 808/1652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:36.585659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:36.586054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:36.592687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:36.593174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:36.593614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:36.594412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:36.594867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:36.595382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:36.624183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b595198-bc21-4a71-af43-20d93d249584 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Sep 19 12:10:36.624736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 845/1653] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:37.604193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:37.604795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:37.605860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:37.607022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:37.612242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:37.612737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:37.613180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:37.613918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:37.614381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:37.614808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:37.615110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:37.615601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:37.616033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:37.616729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:37.617176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:37.617597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:37.805523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:37.813804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7e3b3f57-acce-4809-9e57-2859af0f93ae tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.214108 Sep 19 12:10:37.814377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 809/1654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:37 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:37.818781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:37.821280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:37.823586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:37.826875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-889db09b-cd58-457b-bf67-0f9c8857507c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.224893 Sep 19 12:10:37.827545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 846/1655] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:37.829722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:37.830239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:37.830676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:37.831376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:37.831956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:37.832384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:37.862210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3817323-c129-413b-841c-9c0cb0b7d495 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Sep 19 12:10:37.862694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 810/1656] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:38.836446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:38.837055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:38.843660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:38.844142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:38.844577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:38.845263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:38.845712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:38.846160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:38.850706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:38.851327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:38.858159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:38.858647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:38.859084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:38.859781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:38.860237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:38.860662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:39.046649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:39.054989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcc129e6-36cf-4257-b893-5b67a2cb470e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.222436 Sep 19 12:10:39.055761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 847/1657] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:38 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:39.060353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:39.061078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:39.062532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:39.068516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:39.069003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:39.069439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:39.070331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:39.070789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:39.071336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:39.077732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93bb2316-68dc-425b-b1e6-e9665f51c665 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.230777 Sep 19 12:10:39.078346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 811/1658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:39.104629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a04ab476-3d66-44db-b762-f5d52701eb52 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048057 Sep 19 12:10:39.105201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 848/1659] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:40.079090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:40.079700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:40.086022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:40.086508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:40.086942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:40.087626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:40.088076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:40.088499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:40.103896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:40.105650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:40.112524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:40.113251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:40.113885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:40.114949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:40.115578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:40.116007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:40.303886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:40.313382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:40.313705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-53f3ce77-6a66-4b28-bf3d-bd80a71e9800 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.239017 Sep 19 12:10:40.314311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 812/1660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:40 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:40.318887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:40.321230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:40.324006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-235adbb0-7b90-40b0-b7f7-a32a586513c2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.224505 Sep 19 12:10:40.324569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 849/1661] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:40.327156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:40.327637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:40.328067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:40.328755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:40.329199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:40.329648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:40.360827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd1041cb-899c-47df-8006-b090f9aea7c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Sep 19 12:10:40.361376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 813/1662] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:41.336832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:41.337437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:41.344141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:41.344666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:41.345057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:41.345911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:41.346197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:41.346610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:41.347640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:41.348814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:41.355409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:41.355889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:41.356322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:41.357017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:41.357468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:41.357936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:41.548398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:41.551831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:41.553540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:41.557546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e63248e-74d7-4261-9a03-60b5b81c6062 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.224554 Sep 19 12:10:41.558144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 850/1663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:41 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:41.561793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c4c0eddd-f133-4332-beb1-dfab6ebb4b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218152 Sep 19 12:10:41.562521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 814/1664] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:41.564108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:41.566439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:41.572231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:41.572952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:41.573584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:41.574487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:41.575714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:41.576302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:41.605051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a96aff2-8077-4a3e-b1e7-9989ec60b6b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045921 Sep 19 12:10:41.605590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 851/1665] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:42.581426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:42.582120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:42.585320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:42.586593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:42.588862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:42.589828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:42.590271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:42.591545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:42.591997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:42.592425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:42.594210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:42.594701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:42.595321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:42.596027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:42.596478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:42.597109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:42.791819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:42.794973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:42.800144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9dcc3951-9ace-4ae8-a00d-24f9ea6b9194 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218498 Sep 19 12:10:42.800730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 852/1666] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:42.803603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfec0397-7c01-4fd7-8566-849f5cc29420 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.226007 Sep 19 12:10:42.806079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 815/1667] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:42 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:42.808403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:42.811395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:42.817994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:42.818595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:42.819130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:42.820038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:42.820662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:42.821091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:42.850845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbb12bba-f62f-488f-be10-8501bc90c3e1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048805 Sep 19 12:10:42.851395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 853/1668] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:43.824088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:43.824648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:43.826922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=72 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:43.828073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:43.828687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:43.832510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:43.833002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:43.833441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:43.834267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:43.834720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:43.834923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:43.835174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:43.835400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:43.835833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:43.836524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:43.836972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:43.837393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:44.030396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:44.033644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:44.038752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06ee2574-63bc-4dd5-b365-b682581bb9c7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.214523 Sep 19 12:10:44.039321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 854/1669] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:43 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:44.041317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-715e02f5-1146-4076-b514-0c27050600dc tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.221143 Sep 19 12:10:44.041895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 816/1670] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:44.044007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:44.046470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:44.052466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:44.053178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:44.053868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:44.054723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:44.055177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:44.055599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:44.084846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f2ec1c7-bfbd-4deb-8086-35cc22ab3571 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 Sep 19 12:10:44.085324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 855/1671] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:45.061523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:45.062171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:45.064074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:45.064679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:45.068681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:45.069170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:45.069613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:45.070341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:45.070802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:45.070961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:45.071230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:45.071442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:45.071875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:45.072569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:45.073017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:45.073437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:45.086034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:45.272218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:45.279448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:45.280372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec0e04e0-dc01-415d-9ad4-1aba0ffbb7e2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.220143 Sep 19 12:10:45.280935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 856/1672] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:45.285512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:45.287867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:45.287994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c4d0ec97-927e-4264-87df-9e2c3880b55e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.230238 Sep 19 12:10:45.288488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 817/1673] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:45 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:45.294296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:45.294782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:45.295209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:45.295896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:45.296337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:45.296750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:45.325378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e87bddd3-b4d5-401e-8277-f848d2b613cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043461 Sep 19 12:10:45.325970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 857/1674] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:46.311668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:46.312282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:46.318907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:46.319619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:46.320253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:46.321149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:46.321787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:46.322375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:46.461029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:46.471360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2771e7c-c72c-4351-a595-bc1d6d84c2b3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.164107 Sep 19 12:10:46.472568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 858/1675] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:46 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:46.477285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:46.479610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:46.481987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:46.487793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:46.488439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:46.488874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:46.489568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:46.490108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:46.490529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:46.524383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:46.525045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:46.531725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:46.532207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:46.532638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:46.533322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:46.533795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:46.534209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:46.534863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6f0f24c-6e60-4a39-9a96-7e47da029a41 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061281 Sep 19 12:10:46.535424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 859/1676] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:46.662829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:46.671134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d09a5ba4-8387-4ade-98b8-0aa8be720a19 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.370297 Sep 19 12:10:46.671694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 818/1677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:47.495617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:47.496175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:47.502660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:47.503136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:47.503570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:47.504251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:47.504700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:47.505119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:47.547996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:47.550296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:47.556831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:47.557322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:47.557754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:47.558484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:47.558928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:47.559379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:47.588448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60a3650c-8b56-448e-a321-193fdf2843ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Sep 19 12:10:47.589269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 819/1678] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:10:47.637109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:47.645844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-badb2901-1a13-4883-98e3-f4856ee4fc67 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154183 Sep 19 12:10:47.646406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 860/1679] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:47 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:47.694073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:47.694687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:47.701102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:47.701586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:47.702061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:47.702751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:47.703207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:47.703639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:47.834325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:47.842862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-117a7b7f-3cae-4227-a2ce-1de467f199a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152654 Sep 19 12:10:47.843417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 820/1680] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:48.603720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:48.606492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:48.613819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:48.614212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:48.615581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:48.615581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:48.616080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:48.616276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:48.646753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f9b9566-1251-40ea-bbc9-9f67a51a9ede tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048860 Sep 19 12:10:48.647313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 861/1681] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:48.668335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:48.669480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:48.675951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:48.676440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:48.676880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:48.677579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:48.678068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:48.678495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:48.808175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:48.816799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-68b2d86a-1e32-48dd-abee-8f1bb8660d22 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152384 Sep 19 12:10:48.817396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 821/1682] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:48 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:48.866368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:48.867189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:48.873554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:48.874070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:48.874505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:48.875193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:48.875643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:48.876073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:49.006396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:49.014672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b7753b1-74c3-4cc6-9d47-6397223e87f4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152105 Sep 19 12:10:49.015239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 862/1683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:49.659628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:49.661991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:49.667767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:49.668243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:49.669255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:49.669975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:49.670421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:49.670832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:49.699239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b472d88-3779-451b-b246-448b7f576cea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 Sep 19 12:10:49.699780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 822/1684] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:49.840849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:49.841490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:49.848257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:49.848732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:49.849159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:49.849977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:49.850428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:49.850845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:49.980132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:49.990383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98b110c7-87db-4236-b91f-b14b09ac931f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153569 Sep 19 12:10:49.990966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 863/1685] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:49 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:50.037704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:50.038348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:50.044275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:50.044755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:50.045178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:50.045884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:50.046335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:50.046753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:50.175086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:50.182751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0285a9f3-b350-446f-acc2-0d197a8d188d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148872 Sep 19 12:10:50.183313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 823/1686] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:50.711524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:50.713727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:50.720509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:50.720990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:50.721420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:50.722518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:50.722641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:50.723020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:50.752260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c0e204ca-0072-4afa-9a20-d3cb95188c1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Sep 19 12:10:50.752802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 864/1687] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:51.012760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:51.013396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:51.019701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:51.020178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:51.020609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:51.021288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:51.021735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:51.022184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:51.150339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:51.158558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38a12e64-351f-4563-878c-94ce834fc842 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149609 Sep 19 12:10:51.159119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 824/1688] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:51 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:51.206344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:51.206989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:51.213293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:51.213721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:51.214449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:51.215141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:51.215598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:51.216022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:51.347463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:51.355092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65dfdfc5-aa4c-42ba-92da-008a1142ae63 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152632 Sep 19 12:10:51.355647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 865/1689] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:51.764979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:51.767135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:51.772935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:51.773411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:51.773875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:51.774561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:51.775004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:51.775418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:51.807067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-50078250-4528-4d85-ba54-46a0c7558ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Sep 19 12:10:51.807614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 825/1690] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:52.180351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:52.180962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:52.187543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:52.188025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:52.188462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:52.189153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:52.189604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:52.190055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:52.317108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:52.325339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0abfec96-497b-4f7a-b002-b39e452d8308 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148870 Sep 19 12:10:52.325953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 866/1691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:52 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:52.379281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:52.379933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:52.386377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:52.386861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:52.387301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:52.387994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:52.388452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:52.388882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:52.517734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:52.525366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8988cd6d-fd4b-4205-b045-a5500bff3f07 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149938 Sep 19 12:10:52.525905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 826/1692] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:52.819707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:52.821971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:52.827760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:52.828242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:52.828677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:52.829366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:52.829866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:52.830296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:52.847367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:52.861751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32ac1cc7-e047-465e-9e4c-7e841324d1b4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045925 Sep 19 12:10:52.862336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 867/1693] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:53.348460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:53.348995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:53.354981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:53.355464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:53.355902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:53.356594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:53.357048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:53.357471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:53.481075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:53.489209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ff71406-41d2-4097-b433-ba4e24cdccca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.144699 Sep 19 12:10:53.489787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 827/1694] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:53 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:53.548573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:53.549166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:53.555397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:53.555872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:53.556321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:53.556993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:53.557436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:53.557875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:53.688063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:53.695675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0501f24c-f6a8-4fe9-bb75-3e1dc7c9ef1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150892 Sep 19 12:10:53.696240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 868/1695] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:53.874882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:53.876889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:53.882925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:53.883495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:53.883940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:53.884649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:53.885101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:53.885576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:53.915134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b8de378-d1de-4649-9d69-0a2a48b5d131 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Sep 19 12:10:53.915697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 828/1696] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:10:54.512437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:54.512958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:54.519016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:54.519488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:54.519911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:54.520585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:54.521030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:54.521443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:54.656959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:54.665066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32060b2e-58dc-48b9-824e-efccc3a77299 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156600 Sep 19 12:10:54.665624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 869/1697] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:54 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:54.719818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:54.720426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:54.726725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:54.727208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:54.727642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:54.728337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:54.728791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:54.729215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:54.855733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:54.863979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5a28b471-e776-4852-999c-67179d533996 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148528 Sep 19 12:10:54.864543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 829/1698] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:54.930144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:54.932309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:54.939179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:54.939828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:54.940362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:54.941214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:54.941800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:54.942399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:54.972608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-936dc93d-8c20-4d5a-a3d2-24d2d26baabb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Sep 19 12:10:54.973168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 870/1699] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:55.688336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:55.688949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:55.694935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:55.695457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:55.695903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:55.696601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:55.697059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:55.697486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:55.826859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:55.835126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ac6a8431-d08a-44c2-ac1e-cc50bdffa6e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150680 Sep 19 12:10:55.835681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 830/1700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:55 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:55.886340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:55.886953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:55.894025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:55.894506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:55.894937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:55.895621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:55.896069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:55.896529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:55.984681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:55.987005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:55.993141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:55.993605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:55.996863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:55.996863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:55.996863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:55.996863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:56.025987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5bc0e53a-f75b-4e3a-ac08-a7e5af47fa79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Sep 19 12:10:56.026743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 831/1701] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:10:56.032246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:56.039970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56be3ff9-a238-44fa-8406-142d29793271 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157385 Sep 19 12:10:56.040525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 871/1702] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:56.858568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:56.859177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:56.865628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:56.866133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:56.866563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:56.867243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:56.867687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:56.868102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:56.991816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:57.000344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4faca1e-3334-4714-b41f-05dbbbd9417f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.145585 Sep 19 12:10:57.000904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 832/1703] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:56 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:57.038862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:57.041023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:57.047419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:57.047782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:57.048208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:57.048885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:57.049330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:57.049743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:57.063834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:57.063982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:57.071158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:57.071639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:57.072066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:57.072756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:57.073203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:57.073610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:57.080506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-063979bb-28ef-4ae7-a973-ed0ad6ee910b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Sep 19 12:10:57.081301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 872/1704] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:10:57.204987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:57.212779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-743cde32-916e-4f6f-aeb1-c5117e6aa693 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153801 Sep 19 12:10:57.213378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 833/1705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:58.023510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:58.024122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:58.030597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:58.031077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:58.031510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:58.032227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:58.032681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:58.033104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:58.093346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:58.095609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:58.101734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:58.102277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:58.102713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:58.103405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:58.103861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:58.104277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:58.108563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:10:58.168166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:58.177034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5599216c-d706-4c8e-82d9-3c56617e595e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.157255 Sep 19 12:10:58.181873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 873/1706] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:58 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:58.235964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:58.236590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:58.242910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:58.243404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:58.243841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:58.244547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:58.245000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:58.245427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:58.293255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5284114a-90c3-47ef-a08d-889a890f69ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204463 Sep 19 12:10:58.293714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 834/1707] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:10:58.381976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:58.390054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ac20b84-1669-4d4a-af71-fb53d8a68ca9 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158140 Sep 19 12:10:58.390618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 874/1708] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:10:59.200162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:59.200822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:59.207082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:59.207565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:59.208004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:59.208697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:59.209150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:59.209569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:59.305730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:59.308134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:59.314275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:59.314838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:59.315280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:59.315982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:59.316438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:59.316877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:59.339959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:59.347700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f694e32e-3632-447e-ae23-c4832bbdc041 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045958 Sep 19 12:10:59.348304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 875/1709] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:10:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:10:59.349053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a39b54ca-f92e-4632-acbd-a8bd8b09ab92 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152268 Sep 19 12:10:59.349227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 835/1710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:59 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:10:59.413610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:10:59.414178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:10:59.420698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:59.421174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:59.421602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:59.422309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:10:59.422755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:10:59.423167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:10:59.554486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:10:59.562016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f0492e1-1f17-4936-978f-294a0ce59c1f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152158 Sep 19 12:10:59.562570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 876/1711] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:10:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:00.359957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:00.362112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:00.368767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:00.369253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:00.369689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:00.370409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:00.370871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:00.371245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:00.371683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:00.371852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:00.378801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:00.379274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:00.379704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:00.380391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:00.380838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:00.381254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:00.400985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-348b71ff-1ef3-4330-ae90-b0a70b16a9fd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045368 Sep 19 12:11:00.401690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 836/1712] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:00.510734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:00.518893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9392b580-19d3-4e0c-ad3b-fa2f3e55f88d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151440 Sep 19 12:11:00.519459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 877/1713] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:00 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:00.585272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:00.585921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:00.592106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:00.592593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:00.593033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:00.593730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:00.594207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:00.594635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:00.721399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:00.729059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-acbc28e6-73a7-4ba7-abb8-37b6df872f02 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.147732 Sep 19 12:11:00.729618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 837/1714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:01.412666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:01.414782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:01.421184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:01.421661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:01.422129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:01.422814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:01.423264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:01.423686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:01.453023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-abcfa0ae-942f-499e-b376-ccfd9ce219e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Sep 19 12:11:01.453555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 878/1715] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:01.541757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:01.542394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:01.548805 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:01.549292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:01.549731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:01.550453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:01.550911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:01.551339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:01.684450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:01.693079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3ddd934c-eda3-4deb-af9a-5461e3ca0871 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.155199 Sep 19 12:11:01.693634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 838/1716] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:01 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:01.752734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:01.753346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:01.759174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:01.759658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:01.760093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:01.760780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:01.761231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:01.761657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:01.891309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:01.898891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4af48218-53b1-4378-b5e1-08d8493477ad tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150470 Sep 19 12:11:01.899444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 879/1717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:02.466051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:02.468641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:02.474571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.475058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.475496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.476186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.476642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.477069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.506341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f94c3a39-bb1b-4b2c-90fa-0b597339decc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Sep 19 12:11:02.506881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 839/1718] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:02.716564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:02.717127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:02.724316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.724795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.725227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.725951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.726907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.727328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.855714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:02.863916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-930733f7-9270-480b-843d-fcb4d37d5c66 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151562 Sep 19 12:11:02.864481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 880/1719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:02 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:02.921366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:02.922005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:02.928310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.928795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.929231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.929956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.930413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.930839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:03.058890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:03.067469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6363a81-53ed-4f74-9e3f-615b6f3ac79a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149740 Sep 19 12:11:03.068291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 840/1720] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:03.518467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:03.520713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:03.526465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:03.526940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:03.527368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:03.528048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:03.528492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:03.528906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:03.557234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03b9c2e0-02ff-46c9-80f8-7f73e91b3163 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042720 Sep 19 12:11:03.557820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 881/1721] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:03.886838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:03.887378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:03.893518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:03.894027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:03.894461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:03.895153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:03.895631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:03.896052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:04.023411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:04.032116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85c7bc7f-7b4c-46b4-b8a7-84d6e15962e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149209 Sep 19 12:11:04.032701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 841/1722] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:03 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:04.091709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:04.092459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:04.099392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:04.099874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:04.100318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:04.101008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:04.101459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:04.101918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:04.234723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:04.242224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c84ec150-ca47-47ab-964d-366e18a3cd84 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154613 Sep 19 12:11:04.242782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 882/1723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:04.570371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:04.572539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:04.579176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:04.579667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:04.580108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:04.580806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:04.581276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:04.581689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:04.611986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6436ff37-73f2-48b0-9310-e81c7cc3aff5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Sep 19 12:11:04.612541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 842/1724] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:05.055494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:05.056103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:05.062764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:05.063240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:05.063671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:05.064359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:05.064808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:05.065229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:05.192409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:05.200492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8aedb24-11c9-4edf-815d-dfb105b3e87a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148829 Sep 19 12:11:05.201048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 883/1725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:05 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:05.264225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:05.264863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:05.271248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:05.271705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:05.272146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:05.272841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:05.273298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:05.273729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:05.408945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:05.416605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3f740f4a-31bb-4482-80cb-41909f87bf05 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156201 Sep 19 12:11:05.417168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 843/1726] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:05.624454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:05.626616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:05.632524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:05.633032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:05.633465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:05.634184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:05.634635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:05.635053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:05.638657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:05.672012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efaa345a-5c5b-4e98-a8cf-61557d96ccaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051480 Sep 19 12:11:05.672574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 884/1727] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:06.223491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:06.224099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:06.230050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.230532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.230966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.231651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.232102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.232531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.356592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:06.365232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b69a4a4c-bd89-4d47-9746-381084688d79 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.145608 Sep 19 12:11:06.365806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 844/1728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:06 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:06.440137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:06.440738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:06.446954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.447425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.447852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.448528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.448969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.449382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.577980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:06.586037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4b7269d-cc05-47c6-9a7b-caa8b13a2593 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149952 Sep 19 12:11:06.586314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 885/1729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:06.684511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:06.687391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:06.693713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.693881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.694319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.695107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.695668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.696107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.728102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57b6d6c6-d30f-4375-829c-447032675af7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047562 Sep 19 12:11:06.728661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 845/1730] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:07.388606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:07.389737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:07.391846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:11:07.391985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:11:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 (ip 10.222.0.88) !!! Sep 19 12:11:07.397534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:07.398098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:07.398486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:07.399176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:07.399629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:07.400052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:07.525150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:07.533420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af32d425-6ec3-4ed5-b7b3-425f0b9e05e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148707 Sep 19 12:11:07.534054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 886/1731] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:07 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:07.608373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:07.608980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:07.615545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:07.616029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:07.616467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:07.617165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:07.617620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:07.618080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:07.740356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:07.742573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:07.746380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:07.748509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:07.748999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:07.750486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:07.750666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:07.751305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:07.751889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:07.761734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e20dc792-20b2-4af1-904d-129a66a157c3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.157176 Sep 19 12:11:07.762383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 846/1732] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:07.781928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-657a9cf3-710e-4150-a968-44e71b70548b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Sep 19 12:11:07.782479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 887/1733] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:08.556646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:08.557254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:08.563232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:08.563733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:08.564169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:08.564857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:08.565309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:08.565750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:08.694826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:08.703843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ccae8430-f2ce-40ea-b575-2ca1e400a5e1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151020 Sep 19 12:11:08.705105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 847/1734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:08 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:08.785956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:08.786602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:08.793304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:08.793846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:08.794078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:08.794294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:08.794990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:08.795448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:08.795876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:08.796195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:08.802053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:08.802537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:08.802970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:08.803660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:08.804110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:08.804534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:08.834347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6986643-3735-41c8-9e76-974cdbf8c405 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Sep 19 12:11:08.834830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 848/1735] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:08.923081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:08.930672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c3bfb70-3426-4ae4-a3a5-18293154c091 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148633 Sep 19 12:11:08.931241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 888/1736] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:08 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:09.730145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:09.730752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:09.737711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.738233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.738667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.739362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.739818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.740244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.847414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:09.849574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:09.855932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.856415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.856852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.857542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.858021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.858444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.871236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:09.879993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6a06e4d-7b2b-4814-adc2-d9867bf57102 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153756 Sep 19 12:11:09.880569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 849/1737] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:09 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:09.891120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5fbd0060-8143-4378-b743-438c282c4a09 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048256 Sep 19 12:11:09.891659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 889/1738] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:09.953169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:09.953791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:09.959854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.960334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.960764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.961454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.961936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.962359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:10.098285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:10.100377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:10.108085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08266b16-9bfd-41d6-86fd-5c551decb46e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158391 Sep 19 12:11:10.108342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 850/1739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:10.903453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:10.904060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:10.904425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:10.905616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:10.910568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:10.911051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:10.911481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:10.912073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:10.912196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:10.912558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:10.912684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:10.913000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:10.913120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:10.913691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:10.914173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:10.914599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:10.946617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-851bd386-32c9-4b10-817b-fdbc9479531d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Sep 19 12:11:10.947181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 890/1740] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:11.038222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:11.046868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e14840b7-aa95-4418-97d6-42a87d552b68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.146760 Sep 19 12:11:11.047428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 851/1741] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:10 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:11.131234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:11.131847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:11.137666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:11.138180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:11.138617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:11.139307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:11.139761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:11.140185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:11.268552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:11.276421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d5f8cd9-72f8-4fe8-be60-a1245cab7acf tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148972 Sep 19 12:11:11.277129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 891/1742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:11.959452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:11.961603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:11.968343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:11.968824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:11.969303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:11.970021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:11.970481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:11.970903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:12.000030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9350d201-8a60-46f3-bf76-55b9f4b73f20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Sep 19 12:11:12.000567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 852/1743] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:12.069719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:12.070352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:12.076854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:12.077989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:12.078438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:12.079184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:12.079637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:12.080061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:12.207572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:12.215920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de3c6826-768f-489b-bc78-8ce649fb78b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150059 Sep 19 12:11:12.216472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 892/1744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:12 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:12.300583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:12.301186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:12.306974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:12.307449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:12.307877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:12.308558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:12.309004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:12.309423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:12.437628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:12.445140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8f98e404-82fa-40e0-946a-31c807709ff8 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148828 Sep 19 12:11:12.445692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 853/1745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:13.012213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:13.014375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:13.020177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.020648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.021083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.021775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.022227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.022643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.051766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c8cb3a1-0b4c-4981-9e1b-9992e4e299c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043498 Sep 19 12:11:13.052304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 893/1746] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:13.237710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:13.238357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:13.244687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.245206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.245646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.246445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.246901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.247330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.372316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:13.380521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-83aecd90-4afd-4d92-a82e-5ae3192f4eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.146673 Sep 19 12:11:13.381086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 854/1747] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:13 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:13.467475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:13.468003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:13.474366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.474843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.475273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.475955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.476406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.476822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.606747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:13.614380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-069a3b32-d7d0-4e24-8d75-3bf2de040811 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151105 Sep 19 12:11:13.614969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 894/1748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:13 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:14.064705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:14.066920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:14.068769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=78 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:14.073915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:14.074405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:14.074843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:14.075542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:14.075998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:14.076426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:14.105656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a622eec4-0b48-4516-bc08-111019770baa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Sep 19 12:11:14.106244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 855/1749] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:14.403556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:14.404165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:14.410690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:14.411171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:14.411603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:14.412288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:14.412739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:14.413161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:14.638062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:14.639361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:14.646459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:14.646953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:14.647391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:14.648099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:14.648555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:14.648982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:14.796043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:14.804284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d30955a-4dde-4443-9656-fd655641a315 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.404543 Sep 19 12:11:14.805014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 895/1750] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:14 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:14.823448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:14.831690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-129d5db6-0244-49f0-ac41-9e32ff408dce tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.197597 Sep 19 12:11:14.832256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 856/1751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:15.117916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:15.120064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:15.128101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:15.129212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:15.129329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:15.129998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:15.130457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:15.130885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:15.161751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98c5a96d-c9cf-44bc-b8a6-7133d7ee4cb2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048043 Sep 19 12:11:15.162332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 896/1752] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:15.827941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:15.828551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:15.835018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:15.835501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:15.835935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:15.836632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:15.837080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:15.837503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:15.854515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:15.855146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:15.861358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:15.861869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:15.862302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:15.862985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:15.863428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:15.863851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:16.034112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:16.037833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:16.042444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8d83692-f048-4392-827d-2404fdb714ff tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.218960 Sep 19 12:11:16.043021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 857/1753] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:15 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:16.045783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a35eac17-fe86-48ad-91d0-9dfdddb72986 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.195009 Sep 19 12:11:16.046980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 897/1754] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:16.173374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:16.175547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:16.181368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:16.181884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:16.182325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:16.183021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:16.183475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:16.183900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:16.214985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1229c9e9-a8c5-46f7-937d-e5e707ebd870 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Sep 19 12:11:16.215535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 858/1755] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:17.066541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:17.067129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:17.068741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:17.069161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:17.069417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:17.074589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:17.075064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:17.075491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:17.075615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:17.075976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:17.076183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:17.076411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:17.076656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:17.077076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:17.077192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:17.077586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:17.078044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:17.274899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:17.278489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:17.284671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c561391-a044-4ccd-b813-70855bf61312 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.219803 Sep 19 12:11:17.285606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 859/1756] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:17.287562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e62b8da-3607-4084-8611-fda1af1dcf30 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.224895 Sep 19 12:11:17.288513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 898/1757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:17 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:17.291227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:17.293482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:17.300049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:17.300536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:17.300973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:17.301670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:17.302187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:17.302612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:17.331404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7151d4b3-337e-448d-94fc-f34dd31fb189 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Sep 19 12:11:17.331892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 860/1758] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:18.308920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:18.309623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:18.312168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:18.312783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:18.316562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:18.317071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:18.317500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:18.318209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:18.318654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:18.319068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:18.319225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:18.319899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:18.320336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:18.321032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:18.321490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:18.321946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:18.510515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:18.515195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:18.518313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c313f3d1-6814-49a2-9d59-a0dd6d2ff97f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.213158 Sep 19 12:11:18.518884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 899/1759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:18 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:18.523690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:18.526137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:18.527828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ef43aa52-e06a-4a72-8a70-6a932b24a6a6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.220054 Sep 19 12:11:18.528526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 861/1760] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:18 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:18.536373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:18.536921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:18.537353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:18.538086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:18.538533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:18.538950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:18.564508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:18.569524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fabb02f1-2b06-4f7c-afdd-cc203540a097 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049503 Sep 19 12:11:18.570113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 900/1761] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:19.541521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:19.542220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:19.550697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:19.551193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:19.551314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:19.551898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:19.552341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:19.553050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:19.553515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:19.553979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:19.557809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:19.558293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:19.558718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:19.559405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:19.559849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:19.560261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:19.757688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:19.762062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:19.766117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-484f54ab-8f42-4ff9-bf76-749bd77f4337 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.219068 Sep 19 12:11:19.766682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 901/1762] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:19 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:19.769804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c884041b-03e3-4de6-8655-401fb89b61c1 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.232124 Sep 19 12:11:19.770585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 862/1763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:19.771458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:19.773558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:19.779354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:19.779769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:19.780695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:19.781578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:19.782043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:19.782458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:19.811119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5078eccc-44f3-476c-8f51-73d7e3ef83ba tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Sep 19 12:11:19.811666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 902/1764] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:20.789463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:20.790094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:20.792954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:20.793568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:20.797110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:20.797591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:20.798056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:20.798742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:20.799195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:20.799612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:20.800349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:20.800834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:20.801271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:20.801990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:20.802449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:20.802870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:20.992165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:20.996637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:21.000802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a687fad6-e4a0-4798-9802-f01d5b18ab4c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.215322 Sep 19 12:11:21.001466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 863/1765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:20 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:21.004335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47a673f4-4946-4aa9-a8e0-670b6881ee1d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.215117 Sep 19 12:11:21.005357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 903/1766] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:21.006536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:21.008725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:21.014532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:21.015093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:21.015598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:21.016349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:21.016801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:21.017222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:21.047603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d5ae990-5dee-4a32-9ba4-8e46f6b61483 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 Sep 19 12:11:21.048157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 864/1767] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:22.023403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:22.024009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:22.028040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:22.028658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:22.030517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:22.030997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:22.031428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:22.032150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:22.032598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:22.033030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:22.035106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:22.035653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:22.036100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:22.036804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:22.037262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:22.037689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:22.218788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:22.226822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c6bc6f3-6d38-4d3d-b3c9-1457a3389f68 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.207318 Sep 19 12:11:22.227413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 904/1768] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:22 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:22.231679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:22.231895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:22.234752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:22.240237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9cc73cd8-4ada-4f60-9a37-7b59b5f49d11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.216013 Sep 19 12:11:22.240389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:22.240759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:22.241808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:22.241958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 865/1769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:22.242055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:22.242340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:22.242756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:22.271608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9444f99-5459-4151-8de6-4f8afbd83090 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 Sep 19 12:11:22.272143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 905/1770] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:23.250861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:23.251476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:23.257915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:23.258405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:23.258847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:23.259546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:23.260006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:23.260435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:23.263985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:23.265261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:23.271626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:23.272110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:23.272545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:23.273242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:23.273694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:23.274147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:23.457727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:23.461026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:23.466348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30a38b1e-60dc-4ea4-bffe-539180db7d35 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.219874 Sep 19 12:11:23.466923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 866/1771] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:23 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:23.469280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fc44236-e190-4dce-9252-8cb4952cbd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.209065 Sep 19 12:11:23.470221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 906/1772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:23 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:23.471579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:23.473722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:23.479548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:23.480044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:23.480485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:23.481187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:23.481642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:23.482348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:23.495836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:23.511986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f9060c9-9d0e-44e6-a184-4cf6f72400d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Sep 19 12:11:23.512540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 867/1773] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:24.490574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:24.491157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:24.492181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:24.492818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:24.497248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:24.497744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:24.498191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:24.498885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:24.499153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:24.499326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:24.499631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:24.499759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:24.500063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:24.500752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:24.501200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:24.501621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:24.645084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:24.653963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-026b4198-1c17-42de-ae5f-88eab4476142 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.165536 Sep 19 12:11:24.654535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 868/1774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:24.659714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:24.661884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:24.667879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:24.668312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:24.668746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:24.669440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:24.669918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:24.670340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:24.700126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86c389c0-fa38-4b2e-803d-1afeec90f0b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Sep 19 12:11:24.700714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 869/1775] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:24.789663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:24.797977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa6d099c-eb2f-4223-892f-c0d0ef720b1f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.311439 Sep 19 12:11:24.798531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 907/1776] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:24 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:25.678841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:25.679401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:25.685960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:25.686449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:25.686888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:25.687587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:25.688143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:25.688458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:25.713503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:25.715897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:25.723803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:25.724336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:25.724722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:25.725427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:25.725974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:25.726391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:25.758319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4474606-928d-481f-98f6-8556fa0d3472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048610 Sep 19 12:11:25.759183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 908/1777] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:25.820600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:25.821213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:25.828844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:25.829343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:25.829809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:25.830526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:25.830977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:25.831401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:25.832857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:25.841018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d78a9005-a150-4924-b595-33c6dec8b9de tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.166046 Sep 19 12:11:25.841794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 870/1778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:25.976944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:25.987034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-534b02c8-8020-4895-9da8-20eae80ae623 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.170248 Sep 19 12:11:25.987694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 909/1779] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:25 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:26.770605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:26.772770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:26.779169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:26.779658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:26.780116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:26.780812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:26.781274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:26.781701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:26.810584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d7ccba0-ca5c-4620-9730-3c211309a4e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Sep 19 12:11:26.811181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 871/1780] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:26.867530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:26.868167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:26.875084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:26.875560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:26.875984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:26.876660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:26.877105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:26.877520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:27.006475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:27.010325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:27.011083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:27.014530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea3cbec4-4fa1-4645-83f9-2d26922fb363 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150709 Sep 19 12:11:27.015109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 910/1781] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:27.017427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:27.018038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:27.018539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:27.019344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:27.019865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:27.020376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:27.150212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:27.158942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf28a52b-251f-4a0c-b713-12751897dfdc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152454 Sep 19 12:11:27.159507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 872/1782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:27 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:27.823424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:27.825514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:27.832035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:27.832516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:27.832950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:27.833634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:27.834119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:27.834539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:27.863215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74f2aaa3-4fe5-4d5a-ba59-16b2d9817e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Sep 19 12:11:27.863744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 911/1783] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:28.038359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:28.039127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:28.046214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:28.046693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:28.047120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:28.047969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:28.048418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:28.048835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:28.177159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:28.182579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:28.183267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:28.185076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bb88e110-496c-403f-8114-3e12a5e6502b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150663 Sep 19 12:11:28.185637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 873/1784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:28.190478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:28.190955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:28.191383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:28.192075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:28.192525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:28.192951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:28.319167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:28.327448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89e0e495-0807-444f-9163-a35bf2f30d0b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148753 Sep 19 12:11:28.328013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 912/1785] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:28 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:28.875338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:28.877485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:28.883482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:28.883961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:28.884398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:28.885085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:28.885535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:28.885984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:28.916223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6266db7c-2626-4b18-a0c5-b4f889592967 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Sep 19 12:11:28.916803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 874/1786] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:29.208813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:29.209423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:29.216145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:29.216631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:29.217064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:29.217748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:29.218223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:29.218645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:29.349826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:29.350474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:29.351603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:29.356917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:29.357529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:29.358006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:29.358711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:29.359167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:29.359296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a73fb89-a94c-4d5b-83e2-0d6e1b5a8aef tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154393 Sep 19 12:11:29.359591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:29.359833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 913/1787] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:29 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:29.484981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:29.493121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b9d4dc5-4ccf-499d-98ef-4e2f5bf6b59a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.147364 Sep 19 12:11:29.493716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 875/1788] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:29 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:29.927686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:29.929805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:29.935632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:29.936350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:29.936569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:29.937260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:29.937916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:29.939497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:29.971720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-999e4c56-bc46-44cc-8a94-81c07220910f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047959 Sep 19 12:11:29.972259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 914/1789] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:30.382920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:30.383527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:30.390488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:30.390913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:30.391346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:30.392039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:30.392493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:30.392918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:30.516914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:30.517515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:30.523727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:30.524204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:30.524656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:30.525341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:30.525749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:30.525910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:30.526221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:30.534217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b548d94-14cd-4dbe-a46a-86f80498f577 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155502 Sep 19 12:11:30.534787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 876/1790] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:30.651932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:30.660679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02979e33-3100-4bd6-8451-db22c67ab8fb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148078 Sep 19 12:11:30.661228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 915/1791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:30 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:30.984008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:30.986233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:30.992147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:30.992632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:30.993065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:30.993752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:30.994226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:30.994643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:31.023968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97defbe8-b8c8-44ff-8a87-7f35746271d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Sep 19 12:11:31.024515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 877/1792] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:31.557175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:31.557783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:31.564124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:31.564603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:31.565030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:31.565741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:31.566207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:31.566624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:31.684068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:31.684814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:31.691478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:31.691965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:31.692409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:31.693108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:31.693562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:31.693689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:31.694015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:31.701311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec98c284-9b2c-43fb-a931-67e3b5211997 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.147934 Sep 19 12:11:31.701887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 916/1793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:31.822350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:31.831007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-23a094a5-c799-4d2b-9c33-883775ea75a0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150954 Sep 19 12:11:31.831571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 878/1794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:31 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:32.036699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:32.038895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:32.044737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:32.045216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:32.045670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:32.046378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:32.046822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:32.047236 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:32.063224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:32.076316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f685a9c-9826-402d-a008-8d42be1d1968 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Sep 19 12:11:32.077275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 917/1795] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:32.724679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:32.725290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:32.731770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:32.732258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:32.732698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:32.733912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:32.734377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:32.734799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:32.854632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:32.855243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:32.862507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:32.862965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:32.863484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:32.864045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:32.864782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:32.865238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:32.865663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:32.870019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57f2db38-5fb9-4e15-86c7-0797df6ead18 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149195 Sep 19 12:11:32.870588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 879/1796] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:32.995424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:33.003516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6832e3cf-da59-4378-be4a-07dfcf24d9fc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152746 Sep 19 12:11:33.004073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 918/1797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:32 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:33.089262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:33.091588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:33.098020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:33.098418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:33.098861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:33.099607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:33.100072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:33.100498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:33.129683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3e23687-e2fb-4962-96b5-1e1f0c643084 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 19 12:11:33.130597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 880/1798] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:33.894441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:33.895051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:33.901362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:33.901873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:33.902310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:33.903031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:33.903485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:33.903907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:34.026301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:34.026916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:34.031666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:34.033375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:34.033895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:34.034335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:34.035035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:34.035489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:34.035916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:34.039625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c58f101-3e28-47a2-a3b4-a7a2bdd7d78a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149108 Sep 19 12:11:34.040194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 919/1799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:34.142608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:34.144896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:34.150931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:34.151423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:34.151860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:34.152638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:34.153097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:34.153522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:34.171315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:34.180499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97d0879e-b023-49ae-a9ba-12947a667cf0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.158060 Sep 19 12:11:34.181074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 881/1800] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:34 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:34.188553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67ce5bcc-038b-4290-9e00-b3fcee371915 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050283 Sep 19 12:11:34.189105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 920/1801] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:35.063497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:35.064113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:35.070793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:35.071293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:35.071733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:35.072455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:35.072912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:35.073339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:35.201282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:35.204045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:35.204330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:35.211385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:35.211871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:35.212252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a2dec8a-e65a-4d58-b72a-1cc79ae20936 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152596 Sep 19 12:11:35.212406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:35.212879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 882/1802] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:35.213020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:35.213433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:35.213876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:35.217798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:35.218425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:35.224154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:35.224649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:35.225092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:35.225937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:35.226406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:35.226839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:35.247563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4ab648c-c381-4d23-8d5b-5197c167cc9b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050973 Sep 19 12:11:35.248783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 921/1803] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:35.353752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:35.361856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47a92daf-bef9-4bfe-9cbd-0995c0f73154 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148025 Sep 19 12:11:35.362412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 883/1804] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:35 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:36.236557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:36.237165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:36.243687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:36.244166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:36.244597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:36.245280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:36.245730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:36.246186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:36.260599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:36.262729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:36.270893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:36.271396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:36.271824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:36.272531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:36.273016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:36.273445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:36.277551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:36.308654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c0b248dd-4cea-4f3b-8382-0ddacce5b701 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052126 Sep 19 12:11:36.309357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 884/1805] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:36.386044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:36.387243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:36.388114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:36.395815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb1eefcd-51e4-4858-845e-c800b0010db6 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.163605 Sep 19 12:11:36.396380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 922/1806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:36.398102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:36.398555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:36.399002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:36.399717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:36.400180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:36.400611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:36.528360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:36.537349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9f395a8-e684-43cf-b886-6f87143e19b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156683 Sep 19 12:11:36.537964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 885/1807] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:36 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:37.321035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:37.323164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:37.329045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:37.329524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:37.329990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:37.330682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:37.331129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:37.331548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:37.361354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efaa91f5-3178-4690-bf07-64271fe161c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Sep 19 12:11:37.362011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 923/1808] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:37.423652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:37.424275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:37.430800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:37.431281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:37.431715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:37.432435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:37.432888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:37.433313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:37.561009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:37.561625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:37.564690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:37.572593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e69570ba-b2f6-47ea-8c16-2b34a05c9eca tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153537 Sep 19 12:11:37.580493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 886/1809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:37.580647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:37.580647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:37.580647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:37.580647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:37.581061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:37.581061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:37.711085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:37.720088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93ed0505-1670-4e20-833e-d188c8e17017 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.163513 Sep 19 12:11:37.720663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 924/1810] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:37 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:38.373746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:38.375937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:38.382237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:38.382602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:38.383042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:38.383750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:38.384208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:38.384637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:38.414355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ebff83a-981d-4d35-9d23-cb2336df9312 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Sep 19 12:11:38.414927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 887/1811] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:38.596137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:38.596748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:38.603023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:38.603526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:38.603993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:38.604690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:38.605147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:38.605572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:38.732231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:38.740580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-152acb64-1e09-43e7-9deb-b17aa3bcdc82 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148260 Sep 19 12:11:38.741145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 925/1812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:38.743520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:38.744125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:38.751046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:38.751521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:38.751951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:38.752637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:38.753082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:38.753500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:38.880918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:38.889146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e4a37db6-7e23-473c-b6eb-922b8d8743e9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149475 Sep 19 12:11:38.889696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 888/1813] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:38 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:39.430635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:39.432685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:39.440493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:39.440944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:39.441376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:39.442102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:39.442555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:39.442977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:39.473134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87fb6808-24aa-4292-ae1b-e89bf3438bb8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050522 Sep 19 12:11:39.474057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 926/1814] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:39.765207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:39.765735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:39.772097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:39.772576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:39.773005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:39.773693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:39.774197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:39.774617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:39.901034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:39.908702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5cc741e-f81f-4421-a266-443c3c3d1d2a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148243 Sep 19 12:11:39.909281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 889/1815] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:39 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:39.912339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:39.912951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:39.919260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:39.919735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:39.920167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:39.920853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:39.921303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:39.921718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:40.049854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:40.060081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34bc7b54-2f1f-4d2a-98cb-63d1e6f2ea01 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151113 Sep 19 12:11:40.061865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 927/1816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:39 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:40.486367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:40.488521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:40.494565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:40.495052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:40.496063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:40.496191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:40.496611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:40.497030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:40.527476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0501a938-bba3-404f-9ee7-80833262f487 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Sep 19 12:11:40.528038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 890/1817] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:40.931194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:40.931887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:40.938112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:40.938588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:40.939013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:40.939692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:40.940165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:40.940581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:41.074428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:41.082666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fabd1e11-142b-4435-adba-49a8f1ad688a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155245 Sep 19 12:11:41.083227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 928/1818] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:41.089725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:41.090469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:41.097788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:41.098462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:41.098974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:41.099750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:41.100279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:41.100789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:41.231185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:41.239256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7350d462-3ec1-4ed1-a7ef-0e739a7ea14f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154657 Sep 19 12:11:41.239825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 891/1819] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:41 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:41.540504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:41.542676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:41.548952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:41.549431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:41.549890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:41.550615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:41.551060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:41.551472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:41.582864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d393acc-ecf3-4d1f-8344-83be10047716 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046304 Sep 19 12:11:41.583481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 929/1820] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:42.108021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:42.108576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:42.114939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:42.115427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:42.115867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:42.116563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:42.117022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:42.117458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:42.244360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:42.251931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f03901ca-d3f9-4237-9077-8924b8af87df tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148538 Sep 19 12:11:42.252504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 892/1821] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:42.262705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:42.263316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:42.269647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:42.270168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:42.270610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:42.271298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:42.271751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:42.272184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:42.399696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:42.408575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e324b7c9-9fb9-46e1-936f-4aff11f314ca tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149765 Sep 19 12:11:42.409146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 930/1822] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:42 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:42.596196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:42.598431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:42.604287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:42.604797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:42.605229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:42.605943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:42.606395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:42.606814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:42.636110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-32293dc8-3a6a-4bb0-a6c8-1a7792fa019b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 Sep 19 12:11:42.636685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 893/1823] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:43.275309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:43.275915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:43.282263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:43.282747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:43.283186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:43.283870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:43.284314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:43.284740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:43.416116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:43.424320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fb5eab2-35f4-4b93-a05d-aed79f03fd2e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152879 Sep 19 12:11:43.424919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 931/1824] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:43.431249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:43.431861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:43.438326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:43.438810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:43.439241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:43.439928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:43.440379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:43.440798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:43.565557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:43.573554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-76feb4e7-b56d-47d2-a427-05d738a7fb11 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.146183 Sep 19 12:11:43.574140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 894/1825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:43 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:43.648879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:43.651121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:43.657453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:43.657965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:43.658404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:43.659094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:43.659549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:43.659971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:43.689717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-937b70b4-5b18-4d06-af61-475f0e271ea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Sep 19 12:11:43.690303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 932/1826] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:44.447361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:44.447921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:44.450218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=80 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:44.455991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:44.456466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:44.456895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:44.457584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:44.458061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:44.458483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:44.587660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:44.595824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-67340422-c472-4f86-8fe3-890b09a42ec2 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.152368 Sep 19 12:11:44.596503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 895/1827] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:44.596726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:44.597376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:44.603647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:44.604129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:44.604589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:44.605282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:44.605732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:44.606178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:44.702942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:44.705012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:44.710857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:44.711720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:44.711875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:44.712439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:44.712884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:44.713323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:44.737031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:44.745817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ffbfe217-6dab-4a0b-98bd-dcfd3a78813d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Sep 19 12:11:44.746749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 896/1828] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:44.750678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8b4baf2-bca8-44b6-a2ab-cd0bcb4f9f2f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153282 Sep 19 12:11:44.751431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 933/1829] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:44 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:45.620486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:45.621099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:45.627578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:45.628065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:45.628497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:45.629187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:45.629638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:45.630083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:45.759281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:45.759638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:45.761806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:45.767721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d937e1a-ede1-4d14-8a3b-1f43dda75d6a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151114 Sep 19 12:11:45.768294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 897/1830] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:45 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:45.769040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:45.769529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:45.769999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:45.770699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:45.771144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:45.771782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:45.772690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:45.773280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:45.775611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:45.779536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:45.780019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:45.780449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:45.781139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:45.781586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:45.782106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:45.802327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2fcda59-c037-4962-8f52-1160391544ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046976 Sep 19 12:11:45.803110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 934/1831] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:45.915368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:45.923379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ac7e1598-c61b-4dbd-ad2b-19fea1c31be1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154168 Sep 19 12:11:45.923971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 898/1832] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:45 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:46.791120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:46.791733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:46.798749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:46.799228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:46.799660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:46.800342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:46.800792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:46.801210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:46.814699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:46.816870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:46.823188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:46.823659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:46.824086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:46.824769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:46.825209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:46.825621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:46.856256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9bef0e20-c38a-4800-b187-803f764c820d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Sep 19 12:11:46.856813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 899/1833] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:46.931176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:46.938939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a248cd6-f775-4726-aae5-0cb4d7fd3e11 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151721 Sep 19 12:11:46.939495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 935/1834] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:46.947033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:46.947752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:46.954153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:46.954631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:46.955061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:46.955744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:46.956193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:46.956607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:47.084822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:47.087048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:47.095229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-31cb2e5b-0c84-4de6-91bb-f6ef024e849a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152021 Sep 19 12:11:47.096091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 900/1835] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:46 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:47.868503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:47.870654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:47.873556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=76 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:47.878739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:47.879214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:47.879641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:47.880320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:47.880765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:47.881210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:47.911711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-933d9ad2-8fb7-46dc-845d-d7bbd12fef9e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047258 Sep 19 12:11:47.912241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 936/1836] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:47.961607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:47.962284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:47.969600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:47.970128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:47.970560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:47.971253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:47.971705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:47.972126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:48.103420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:48.111730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6cf552ac-ce6a-40f1-8aa8-96cce85cb6ec tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153980 Sep 19 12:11:48.112604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 901/1837] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:48.118620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:48.120823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:48.127752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:48.128231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:48.128662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:48.129380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:48.129854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:48.130272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:48.257636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:48.265677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78864af7-80ff-46d7-8c65-135ec06e5b49 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151314 Sep 19 12:11:48.266267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 937/1838] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:48 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:48.924176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:48.926377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:48.932414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:48.932900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:48.933337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:48.934057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:48.934520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:48.934946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:48.964671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dcd416d3-6250-4749-a6cc-5f2febcebdfc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Sep 19 12:11:48.965263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 902/1839] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:49.134703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:49.135339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:49.141817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:49.142300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:49.142729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:49.143413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:49.143861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:49.144281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:49.272345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:49.280403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20c937a3-6964-4726-a1f8-a66d4e37b09b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149489 Sep 19 12:11:49.280982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 938/1840] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:49.288498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:49.289108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:49.295978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:49.296479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:49.296907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:49.297623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:49.298105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:49.298523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:49.425019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:49.433649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88586041-4afc-4bec-a4dd-ff30dfdd97e4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149055 Sep 19 12:11:49.434242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 903/1841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:49 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:49.977222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:49.979480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:49.985324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:49.985832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:49.986270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:49.986953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:49.987402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:49.987819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:50.017248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd77d48a-a786-4c83-a70e-9accaa45c69d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Sep 19 12:11:50.018239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 939/1842] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:50.305320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:50.305961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:50.312907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:50.313389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:50.313847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:50.314537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:50.315029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:50.315459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:50.448274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:50.456304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:50.456845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa07166e-a92a-4f9b-8c09-29233beca446 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.155169 Sep 19 12:11:50.456956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:50.466265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 904/1843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:50 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:50.473270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:50.473270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:50.473270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:50.473270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:50.473651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:50.473651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:50.594991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:50.603310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7ebdb44-f8b1-4c09-866c-9b4c598bfbf9 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150864 Sep 19 12:11:50.603869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 940/1844] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:50 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:51.032380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:51.034590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:51.040538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:51.041017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:51.041451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:51.042186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:51.042638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:51.043060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:51.071689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-98a7f2ab-1d3b-4c47-bc16-2649a5079c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Sep 19 12:11:51.072231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 905/1845] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:51.482399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:51.482998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:51.489309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:51.489808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:51.490238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:51.490915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:51.491363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:51.491782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:51.623272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:51.628175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:51.628794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:51.631646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3dbcffb5-9f6f-4ae4-83e6-26d8564b6de5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153078 Sep 19 12:11:51.632202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 941/1846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:51.637895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:51.637895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:51.637895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:51.637895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:51.638304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:51.638304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:51.766448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:51.774553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b9819c1-5e15-4c79-84e5-1440722f314b tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151220 Sep 19 12:11:51.775118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 906/1847] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:51 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:52.084061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:52.086218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:52.092294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:52.092766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:52.093194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:52.093900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:52.094345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:52.094762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:52.123021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97251118-3f1f-48e8-be1a-c85d34d32222 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043027 Sep 19 12:11:52.123555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 942/1848] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:52.656046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:52.656583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:52.663084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:52.663570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:52.664007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:52.664702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:52.665159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:52.665582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:52.792110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:52.796619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:52.797233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:52.799920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-595f675c-3e4a-407c-a239-f99a3d84416d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148308 Sep 19 12:11:52.800497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 907/1849] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:52.803637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:52.804114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:52.804541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:52.805224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:52.805667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:52.806119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:52.933673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:52.941688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae7947f5-a15d-4946-a061-13917d6f7645 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149258 Sep 19 12:11:52.942275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 943/1850] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:52 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:53.136056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:53.138295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:53.144796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:53.145276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:53.145703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:53.146420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:53.146866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:53.147292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:53.175594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e31e2df0-2b5c-47d7-98df-dce19762ff56 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Sep 19 12:11:53.176139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 908/1851] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:53.823622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:53.824227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:53.830682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:53.831160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:53.831588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:53.832273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:53.832722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:53.833143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:53.961726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:53.964776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:53.965383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:53.970221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59c2b166-fec0-44a9-a98a-8b84afe4bb0a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150442 Sep 19 12:11:53.970787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 944/1852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:53.972238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:53.972726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:53.973160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:53.973880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:53.974335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:53.974774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:54.106249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:54.115021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9683ad32-12db-42e3-b0ad-960e4237e735 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154476 Sep 19 12:11:54.115585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 909/1853] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:53 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:54.188123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:54.190341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:54.196183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:54.196662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:54.197094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:54.197791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:54.198248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:54.198668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:54.227633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96c23d63-a2eb-473a-8af3-ad3872a65be0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Sep 19 12:11:54.228181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 945/1854] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:54.994305 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:54.994920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:55.001959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:55.002447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:55.002881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:55.003581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:55.004036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:55.004462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:55.138630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:55.139609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:55.140211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:55.146528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-be4f2033-9736-40c1-b69f-b06df8268e50 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156129 Sep 19 12:11:55.147357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 910/1855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:54 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:55.149259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:55.149742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:55.150194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:55.150891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:55.151333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:55.151746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:55.240579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:55.242796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:55.248755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:55.249811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:55.250259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:55.250967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:55.251424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:55.251851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:55.281087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-34fde1a5-3440-4ba6-a9c1-88f691e8e508 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Sep 19 12:11:55.281661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 911/1856] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:55.281867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:55.290213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5275eaf0-fe41-4a68-89c2-3809d4dcbc09 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156001 Sep 19 12:11:55.290763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 946/1857] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:55 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:56.170268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:56.170905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:56.177265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:56.177748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:56.178215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:56.178900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:56.179348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:56.179768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:56.293223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:56.295570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:56.301631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:56.302157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:56.302589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:56.303276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:56.303726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:56.304150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:56.306851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:56.315547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd336737-9451-4788-9ba6-30ca50093be7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149078 Sep 19 12:11:56.316120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 912/1858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:56.320590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:56.321193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:56.326941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:56.327929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:56.328372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:56.329071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:56.329529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:56.329991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:56.335435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c11b115-2758-4a6c-bb7e-20ff9144ded4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Sep 19 12:11:56.336213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 947/1859] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:56.460905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:56.469281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9df80c38-ced1-4e32-8581-b734353839a8 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152209 Sep 19 12:11:56.469842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 913/1860] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:56 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:57.339428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:57.340037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:57.347189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:57.347669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:57.348097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:57.348623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:57.349037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:57.349206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:57.349619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:57.350833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:57.357205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:57.357685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:57.358252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:57.359125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:57.359577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:57.359997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:57.391379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6c9cdfdb-f182-4efb-a73f-483055f9be2a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Sep 19 12:11:57.392135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 914/1861] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:57.486841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:57.492204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:57.492970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:57.495235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51a9bab5-edb2-46b4-90fe-da6300fc07d7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.159865 Sep 19 12:11:57.499054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:57.499602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:57.500102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:57.500978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:57.501506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:57.502028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:57.504798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 948/1862] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:57.626826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:57.635530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7f874313-fd37-499a-ae61-181ccede9c04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.147419 Sep 19 12:11:57.636904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 915/1863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:57 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:58.403955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:58.406570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:58.412918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:58.413396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:58.413857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:58.414572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:58.415023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:58.415446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:58.444428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f791d91e-58e5-4ac7-b7d3-7121ec202c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Sep 19 12:11:58.444972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 949/1864] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:58.518240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:58.518846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:58.524674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:58.525155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:58.525578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:58.526290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:58.526741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:58.527159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:58.658125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:58.660264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:58.660882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:58.665748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3884d783-b529-4f89-9c13-fc21ed959b5d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151505 Sep 19 12:11:58.666338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 916/1865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:58.666667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:58.667154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:58.667645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:58.668345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:58.668803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:58.669231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:58.794998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:58.798434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:58.804101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6478afcc-ce28-4713-8f74-abd13e80d364 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.147660 Sep 19 12:11:58.804662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 950/1866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:58 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:59.457494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:59.459626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:59.465909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:59.466394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:59.466881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:59.467571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:59.468017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:59.468437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:59.481896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:59.497423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c193799e-ec32-4d98-b38d-4d580d0e513b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Sep 19 12:11:59.498002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 917/1867] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:11:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:59.690843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:59.691454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:59.697932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:59.698416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:59.698852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:59.699546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:59.699998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:59.700419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:59.827054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:59.827661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:59.828775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:59.834066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:59.834550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:59.834977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:59.835669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:59.836115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:59.836535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:59.836766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28213518-64d1-4086-b83f-c9836fda8a6c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150381 Sep 19 12:11:59.837328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 951/1868] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:59.965194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:59.973904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63442bad-382e-45ca-b62a-973b9fd691eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150732 Sep 19 12:11:59.974464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 918/1869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:59 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:00.512051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:00.514147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:00.520493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:00.520973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:00.521405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:00.522113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:00.522566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:00.522993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:00.551639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80d86d98-4aad-43a3-b66a-90f205a65641 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Sep 19 12:12:00.552178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 952/1870] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:00.860039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:00.860684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:00.867079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:00.867562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:00.868000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:00.868689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:00.869141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:00.869559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:00.995675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:00.996223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:00.996831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:01.003588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:01.003879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7a81a650-c10d-4e7a-9aa5-243ffc9da749 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.147583 Sep 19 12:12:01.004064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:01.004449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 919/1871] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:00 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:01.004602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:01.005168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:01.005615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:01.006066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:01.135840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:01.144051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2fb69177-e0e6-4627-b17c-95ea912b5f04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151623 Sep 19 12:12:01.144615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 953/1872] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:00 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:01.564470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:01.566661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:01.572655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:01.573146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:01.573585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:01.574308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:01.574766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:01.575193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:01.604564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1e542913-ad95-4fff-9918-e5f379f2e472 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044120 Sep 19 12:12:01.605119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 920/1873] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:02.027764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:02.028367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:02.035279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:02.035758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:02.036192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:02.036876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:02.037326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:02.037745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:02.166149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:02.166770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:02.167075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:02.173128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:02.173611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:02.174090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:02.174785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dfda6808-e876-4f2a-8119-876a4c24e20a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150912 Sep 19 12:12:02.174914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:02.175234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:02.175345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 954/1874] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:02.175662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:02.302570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:02.310643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-37ba5334-2f66-4524-92c4-610992d6c7a1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.148361 Sep 19 12:12:02.311698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 921/1875] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:02 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:02.617895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:02.620087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:02.626508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:02.626988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:02.627417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:02.628097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:02.628544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:02.629027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:02.657368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13443ea4-920c-4481-a5bb-b88d604ef7a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Sep 19 12:12:02.657948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 955/1876] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:03.198118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:03.198663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:03.205281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:03.205786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:03.206266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:03.206970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:03.207428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:03.207883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:03.333772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:03.334437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:03.336569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:03.340989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:03.341469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:03.341933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:03.343221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:03.343674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:03.344094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:03.345110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b4b8e60d-84c6-4b3d-a63b-2362787c1a86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150940 Sep 19 12:12:03.345675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 922/1877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:03.469560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:03.477620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c98dbd94-27a8-4b89-896a-8dd6c402adfa tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.147784 Sep 19 12:12:03.478211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 956/1878] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:03 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:03.669707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:03.671877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:03.677661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:03.678171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:03.678597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:03.679281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:03.679726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:03.680153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:03.709123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1cda1ecc-44cb-4f09-bc3c-0207c5bdc6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Sep 19 12:12:03.709685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 923/1879] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:04.368372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:04.369014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:04.376020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:04.376502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:04.376935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:04.377651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:04.378129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:04.378551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:04.500280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:04.501001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:04.507520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:04.508007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:04.508443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:04.509237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:04.509355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:04.509689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:04.510143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:04.518803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7cc16afc-a4e3-4612-a80c-3e8938982983 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.154238 Sep 19 12:12:04.519383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 957/1880] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:04.635442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:04.643742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4691af42-9e17-4439-b526-102073e5eb6e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.147353 Sep 19 12:12:04.644318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 924/1881] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:04 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:04.721313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:04.723552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:04.729447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:04.729970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:04.730409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:04.731099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:04.731552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:04.731978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:04.760835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0f05a41-189a-410f-aba1-062883952496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Sep 19 12:12:04.761379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 958/1882] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:05.542928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:05.543568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:05.550585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:05.551008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:05.551441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:05.552139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:05.552593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:05.553020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:05.667599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:05.668235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:05.675081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:05.675558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:05.676018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:05.676710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:05.677158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:05.677578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:05.683983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:05.692275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57d1bd96-6374-4cd1-87ec-b3a9502ac80f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.153222 Sep 19 12:12:05.693051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 925/1883] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:05.774005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:05.776372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:05.782812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:05.783309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:05.783749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:05.784467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:05.784924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:05.785350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:05.806050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:05.815437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b6b65a2-f3b2-4948-9c86-bd5eb4912d1d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151702 Sep 19 12:12:05.816014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 959/1884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:05 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:05.816593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a33bb94d-81b0-4c8d-a619-131cc49d04c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Sep 19 12:12:05.817248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 926/1885] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:12:06.715179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:06.715778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:06.721813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:06.722299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:06.722735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:06.723462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:06.723914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:06.724333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:06.829203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:06.831424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:06.838729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:06.839518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:06.839962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:06.840672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:06.841128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:06.841554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:06.855279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:06.862839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40d8c116-6f5e-4408-8b11-88fd22acd342 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151787 Sep 19 12:12:06.863412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 960/1886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:06 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:06.867872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:06.868463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:06.871494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de8b3976-5014-4add-9485-1bf756832080 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046737 Sep 19 12:12:06.872211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 927/1887] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:06.874544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:06.875017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:06.875437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:06.876119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:06.876562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:06.876973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:07.005668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:07.014804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1847a7ba-c284-4f92-9019-c8564446ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149651 Sep 19 12:12:07.015462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 961/1888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:06 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:07.884359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:07.886414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:07.886823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:07.887034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:07.893436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:07.893960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:07.894106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:07.894399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:07.894516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:07.894891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:07.895090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:07.895543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:07.895646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:07.895966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:07.896069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:07.896430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:07.925827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf468a44-41fa-4c07-b6e6-84352f542d17 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Sep 19 12:12:07.926400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 928/1889] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:12:08.023826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:08.032622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98abe670-2740-4b73-97ba-ada4af415260 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149961 Sep 19 12:12:08.033264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 962/1890] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:07 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:08.036983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:08.037600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:08.043505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:08.043998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:08.044436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:08.045132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:08.045623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:08.046075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:08.176126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:08.184261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-918b2aed-bf80-419e-94d5-78419546a5ab tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151226 Sep 19 12:12:08.184829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 929/1891] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:08 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:08.938380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:08.940522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:08.946904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:08.947387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:08.947824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:08.948543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:08.948997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:08.949423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:08.978249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f122acf-c5b6-4821-a3f6-53ca1647a69f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Sep 19 12:12:08.978792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 963/1892] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:09.055834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:09.056447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:09.062847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:09.063334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:09.063774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:09.064467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:09.064925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:09.065351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:09.195780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:09.203366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79e3493b-7c0b-40e4-9730-761e38b84894 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.151342 Sep 19 12:12:09.204217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 930/1893] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:09 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:09.207632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:09.208246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:09.214411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:09.214888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:09.215321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:09.216007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:09.216458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:09.216876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:09.354654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:09.362946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ecc46b18-2db9-4ac2-b683-6fea270d65a4 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.159220 Sep 19 12:12:09.363519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 964/1894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:09 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:09.991336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:09.993490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:10.000071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:10.000556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:10.000994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:10.001684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:10.002162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:10.002586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:10.032907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-37e20854-7f64-48d7-8219-01996b206654 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Sep 19 12:12:10.033454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 931/1895] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:10.226858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:10.227463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:10.234346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:10.234820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:10.235248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:10.235928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:10.236376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:10.236792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:10.386047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:10.386671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:10.393643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:10.394212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:10.394637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:10.395350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:10.395803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:10.396229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:10.636651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:10.644378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a15f341e-2675-44cb-8884-d7254ca1c74a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.421272 Sep 19 12:12:10.645235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 965/1896] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:10 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:10.647316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:10.655982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3d43dd1-475a-4ced-89f0-3b0b04162e28 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.273953 Sep 19 12:12:10.656595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 932/1897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:10 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:11.045391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:11.047626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:11.053787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:11.054297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:11.054736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:11.055461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:11.055916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:11.056344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:11.085343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-984ea528-8337-4a84-8c51-c03e36e3318e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Sep 19 12:12:11.085909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 966/1898] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:11.667430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:11.667979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:11.674897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:11.675380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:11.675815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:11.676508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:11.676963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:11.677389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:11.677922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:11.678530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:11.684887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:11.685373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:11.686450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:11.687152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:11.687604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:11.688029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:11.705849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:11.873929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:11.877002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:11.881704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2651592c-ebd7-4c24-aa3d-dff5f1ef753c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218273 Sep 19 12:12:11.882302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 933/1899] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:11 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:11.885198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1eba4a3e-1510-4276-86e5-cab1550b5a7a tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.211042 Sep 19 12:12:11.885747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 967/1900] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:11 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:12.098676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:12.100841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:12.106785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:12.107275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:12.108375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:12.109072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:12.109532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:12.109989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:12.113547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:12.139467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e21bb76f-07bb-4347-b9ee-0461de7c2a15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044779 Sep 19 12:12:12.140025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 934/1901] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:12.904866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:12.905493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:12.907496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:12.908108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:12.912016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:12.912495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:12.912932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:12.913624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:12.914103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:12.914519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:12.914638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:12.915063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:12.915501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:12.916264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:12.916729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:12.917152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:13.111345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:13.114468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:13.119025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6c29527-feca-43db-97dc-928e8a852e6f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218011 Sep 19 12:12:13.119627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 968/1902] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:12 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:13.122662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1147ece3-fcf5-45a5-a3d2-c6c658aec478 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.219076 Sep 19 12:12:13.124071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 935/1903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:12 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:13.151705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:13.153864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:13.159716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:13.160134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:13.160564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:13.161245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:13.161691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:13.162136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:13.191383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-795526c2-dee5-4df8-97ef-9eafa934a8cd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 Sep 19 12:12:13.191918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 969/1904] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:14.143883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:14.145116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:14.145687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:14.146318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:14.151780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:14.152262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:14.152696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:14.152829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:14.153228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:14.153393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:14.153664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:14.153872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:14.154301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:14.154883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:14.154883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:14.155267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:14.349487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:14.352663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:14.357281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a36217e-c5b0-4543-89ce-c85bf5dbe020 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218229 Sep 19 12:12:14.357961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 936/1905] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:14 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:14.360812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb4f3508-4f65-4151-888d-08b2af8a328c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.218891 Sep 19 12:12:14.361529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 970/1906] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:14 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:14.362480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:14.364608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:14.370260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:14.370738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:14.371171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:14.371859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:14.372317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:14.372728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:14.402368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8c18c4c-272e-4c4d-964f-4bc1f9e41d0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Sep 19 12:12:14.402850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 937/1907] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:15.380606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:15.381214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:15.384035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:15.384642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:15.387031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=86 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:15.387818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:15.388316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:15.389400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:15.390193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:15.390655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:15.391109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:15.392542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:15.393023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:15.393452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:15.394214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:15.394668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:15.395085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:15.585065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:15.592024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:15.593554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2371272-e59a-4679-bf61-afad21335e7d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.216790 Sep 19 12:12:15.594143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 971/1908] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:15 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:15.598906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:15.600926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-28829de2-538a-474c-a1d8-b1088838f100 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.220640 Sep 19 12:12:15.601067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:15.601480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 938/1909] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:15 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:15.606741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:15.607226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:15.607660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:15.608383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:15.608837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:15.609259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:15.639153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed2b5844-59ca-43db-9aad-54473d89ff33 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043800 Sep 19 12:12:15.640263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 972/1910] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:16.616565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:16.617176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:16.623830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:16.624006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:16.624425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:16.624631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:16.624747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:16.625425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:16.626037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:16.626468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:16.630908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:16.631391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:16.631825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:16.632514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:16.632962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:16.633380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:16.824587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:16.833044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b0ad3dbb-799c-47e0-ae2f-0aefa94b871c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.220389 Sep 19 12:12:16.833460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:16.833798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 939/1911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:16 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:16.838602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:16.841018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:16.843034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c8b7345-955f-429b-8b62-d2389d3a0766 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.222352 Sep 19 12:12:16.845807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 973/1912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:16 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:16.847462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:16.847936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:16.848364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:16.849056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:16.849512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:16.849964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:16.879037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a5989a5e-3070-4c9c-ab24-77bb8956f0ad tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044015 Sep 19 12:12:16.879596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 940/1913] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:17.857415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:17.858014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:17.864616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:17.865099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:17.865532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:17.866245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:17.866591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:17.867000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:17.867102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:17.867198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:17.873978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:17.874459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:17.874886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:17.875565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:17.876011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:17.876424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:18.059707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:18.063331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:18.067929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd0c237c-6e9d-4f15-88fe-3db803b3ade4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.214403 Sep 19 12:12:18.068587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 974/1914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:17 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:18.073101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:18.075353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:18.077475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2eefe96a-e252-43f1-9cb4-a3a511c07955 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.214029 Sep 19 12:12:18.077619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:18.078315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 941/1915] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:17 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:18.082857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:18.083345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:18.083780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:18.084479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:18.084929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:18.085362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:18.114831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12fefa74-0f08-4b30-a589-38c9c5122394 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Sep 19 12:12:18.115297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 975/1916] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:19.093739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:19.094371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:19.100992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:19.101168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:19.101585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:19.101789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:19.102064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:19.102766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:19.103252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:19.103677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:19.108027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:19.108514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:19.108957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:19.109650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:19.110145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:19.110569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:19.298535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:19.301996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:19.310943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39eaf7b3-b45e-4324-8d9c-59b8d66d25fe tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.213537 Sep 19 12:12:19.311522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 976/1917] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:19 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:19.312632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a68422d-7df7-4bfe-996a-417a7a9f163c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.223599 Sep 19 12:12:19.313206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 942/1918] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:19 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:19.316832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:19.318984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:19.325165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:19.325647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:19.326247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:19.327461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:19.327913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:19.328337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:19.357919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c2083d1-31fc-403c-9074-94ca38598336 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Sep 19 12:12:19.358386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 977/1919] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:20.335800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:20.336379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:20.336764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:20.336874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:20.343248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:20.343543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:20.343724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:20.344023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:20.344153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:20.344600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:20.344845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:20.345290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:20.345412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:20.345708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:20.345841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:20.346176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:20.536731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:20.544787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:20.545951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47553a67-3987-4ab3-8cdd-32460797a2eb tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.213353 Sep 19 12:12:20.546608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 943/1920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:20 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:20.551480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:20.553702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:20.553994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c5a33af-2c3d-4764-803b-323695dfd12e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.221467 Sep 19 12:12:20.554647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 978/1921] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:20 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:20.559512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:20.559997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:20.560431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:20.561700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:20.562183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:20.562607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:20.591325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ba9b4e4-e14d-4a73-b78c-fafd37ecfbf0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 Sep 19 12:12:20.591876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 944/1922] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:21.569958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:21.570569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:21.577495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:21.578009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:21.578437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:21.578573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:21.579147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:21.579260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:21.579599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:21.580018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:21.585507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:21.586032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:21.586481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:21.587180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:21.587645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:21.588071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:21.774789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:21.778523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:21.783037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acac2889-1ff6-41d9-bb15-2850a09eac96 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217072 Sep 19 12:12:21.783592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 979/1923] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:21 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:21.786229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3a421712-f563-4c3c-b315-29224b6283a4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.212462 Sep 19 12:12:21.786949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 945/1924] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:21 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:21.788401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:21.790956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:21.796792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:21.797355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:21.797685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:21.798400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:21.798845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:21.799263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:21.830154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c4575dd-51b9-4777-9128-509fd9ea5f69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Sep 19 12:12:21.830711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 980/1925] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:22.807416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:22.808044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:22.808541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:22.809152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:22.814874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:22.815362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:22.815516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:22.815800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:22.815925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:22.816312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:22.816509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:22.816961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:22.817345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:22.817460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:22.817813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:22.818447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:23.009524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:23.016617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:23.017697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-912589ee-b849-4458-9d16-ade92d04bfbb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.213129 Sep 19 12:12:23.018303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 981/1926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:22 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:23.022850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:23.024970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:23.025090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cfe7b9d2-df1a-4fc3-b917-d05545a458c1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.221324 Sep 19 12:12:23.025690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 946/1927] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:22 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:23.031269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:23.034881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:23.035574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:23.036392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:23.037011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:23.037543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:23.066972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-576af557-fde8-4b96-98af-577a74af230a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047679 Sep 19 12:12:23.067530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 982/1928] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:24.041663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:24.042422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:24.048743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:24.049225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:24.049339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:24.049536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:24.050001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:24.050701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:24.051159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:24.051584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:24.055613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:24.056108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:24.056543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:24.057239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:24.057699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:24.058147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:24.250806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:24.254673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:24.258726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-656fdb7a-8880-4a7b-91b8-45bd53a55784 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.220869 Sep 19 12:12:24.259300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 947/1929] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:24 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:24.262868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fcd11ee-9b2c-4707-a062-7e86f3ce6cc2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.218441 Sep 19 12:12:24.263562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 983/1930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:24 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:24.264335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:24.266601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:24.272428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:24.272912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:24.273348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:24.274074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:24.274532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:24.274953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:24.303733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-31d953f4-3603-469b-b689-3650c354324b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Sep 19 12:12:24.304277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 948/1931] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:25.282586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:25.283196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:25.285324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:25.285993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:25.289653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:25.290165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:25.290602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:25.291301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:25.291751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:25.292171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:25.292275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:25.292717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:25.293157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:25.293873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:25.294327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:25.294750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:25.296713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:25.478330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:25.488120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c5761586-3a3f-4e7b-84d7-13c748ee49be tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.206494 Sep 19 12:12:25.488818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 949/1932] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:25 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:25.493689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:25.495891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:25.506546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:25.507060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:25.507501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:25.508222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:25.508783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:25.509208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:25.514362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:25.522089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7cd6a19-8198-4bba-9ef6-4fd073ef59ae tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.243375 Sep 19 12:12:25.522637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 984/1933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:25 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:25.534968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:25.540418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9bfd67f0-e996-4bc1-ae44-8d80f93eaba1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050544 Sep 19 12:12:25.540975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 950/1934] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:26.512284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:26.512284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:26.519007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:26.519505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:26.519932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:26.520613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:26.521055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:26.521469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:26.545944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:26.546592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:26.552752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:26.553231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:26.553661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:26.554383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:26.554830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:26.555248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:26.697332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:26.705490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7924e946-5be7-418d-89f8-b0bda6bf39c0 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.197618 Sep 19 12:12:26.706319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 985/1935] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:26 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:26.711514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:26.713675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:26.721048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:26.721543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:26.722322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:26.723089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:26.723796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:26.724396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:26.742516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:26.750773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3ffbe090-23b3-496a-a4d7-b9033b4b8b96 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.209035 Sep 19 12:12:26.751349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 951/1936] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:26 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:26.756585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96acc01e-bb00-405f-9e31-5133e6ea81d7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049060 Sep 19 12:12:26.757142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 986/1937] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:27.738432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:27.739045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:27.745538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:27.746052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:27.746488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:27.747176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:27.747629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:27.748553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:27.769493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:27.771760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:27.778058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:27.778534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:27.778960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:27.779674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:27.780119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:27.780532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:27.811994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac30c71b-e690-4b60-bb37-069984b1da03 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046384 Sep 19 12:12:27.812550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 987/1938] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:12:27.817110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:27.817700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:27.823284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:27.823764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:27.824203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:27.824871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:27.825312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:27.825722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:27.913276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:27.921735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0311d09-acfc-4153-afb9-b09594bc8ae1 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.187157 Sep 19 12:12:27.922324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 952/1939] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:27 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:27.971774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:27.979359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b29aa5b1-a3c2-4351-ae5e-a64002e5e413 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.165664 Sep 19 12:12:27.979925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 988/1940] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:27 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:28.823885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:28.826596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:28.832751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:28.833237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:28.833673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:28.834408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:28.834863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:28.835290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:28.865470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36347127-2939-4887-9c83-dfb0395328b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Sep 19 12:12:28.866050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 953/1941] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:28.945019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:28.945628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:28.952503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:28.952983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:28.953441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:28.954163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:28.954615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:28.955037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:29.003446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:29.004134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:29.010113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:29.010602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:29.011040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:29.011735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:29.012197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:29.012616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:29.124839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:29.133202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3507646-c3e3-4aeb-b1d8-d37265efe179 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.191994 Sep 19 12:12:29.133808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 989/1942] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:28 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:29.170720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:29.178291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8879d725-b9cb-4764-a617-45578a70cd71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.179363 Sep 19 12:12:29.178847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 954/1943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:28 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:29.878590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:29.880776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:29.886733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:29.887216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:29.887650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:29.888334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:29.888814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:29.889238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:29.918235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-afc0b248-8d07-4f82-91eb-d9d0fb8bb5f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Sep 19 12:12:29.918776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 990/1944] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:30.156920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:30.157664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:30.163935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:30.164411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:30.164839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:30.165519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:30.166005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:30.166421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:30.201953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:30.202674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:30.209188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:30.209747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:30.210283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:30.211062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:30.211515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:30.211937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:30.344946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:30.353027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a36567a-7fb6-4655-9a27-f8135e810b9f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.200431 Sep 19 12:12:30.353847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 955/1945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:30 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:30.376677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:30.384391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39e3b1a7-e17a-4733-90f8-5f8fcf949aff tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.186330 Sep 19 12:12:30.384948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 991/1946] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:30 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:30.931374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:30.933514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:30.939520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:30.940002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:30.940435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:30.941118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:30.941569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:30.942021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:30.970719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d492a430-3c51-4cea-876e-2dd4881b905f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Sep 19 12:12:30.971251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 956/1947] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:12:31.376117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:31.376734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:31.383184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:31.383666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:31.384102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:31.384797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:31.385250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:31.385677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:31.407730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:31.408332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:31.414562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:31.415043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:31.415473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:31.416158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:31.416605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:31.417021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:31.589141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:31.597410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:31.597660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5153160-3f63-46e1-a27b-bed446168760 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.225865 Sep 19 12:12:31.598349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 992/1948] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:31 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:31.605261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-600b0b5c-a4a6-4df6-b614-72f96c0c6d33 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.201338 Sep 19 12:12:31.605840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 957/1949] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:31 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:31.983341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:31.985402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:31.991254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:31.991731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:31.992165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:31.992880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:31.993306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:31.993729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:32.023029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-307367bd-6a06-444d-b894-97c14e5d5a8e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Sep 19 12:12:32.023573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 993/1950] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:12:32.620152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:32.620767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:32.627216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:32.627702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:32.627981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:32.628418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:32.628842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:32.628958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:32.629309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:32.629733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:32.635145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:32.635620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:32.636047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:32.636800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:32.637200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:32.637605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:32.821955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:32.827237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:32.830956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-81dc89bf-46d2-444d-927a-9e3e3af02091 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.214561 Sep 19 12:12:32.831522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 958/1951] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:32 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:32.834835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46ca0b16-ef20-41e0-8540-125c4c0e9add tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.210641 Sep 19 12:12:32.835390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 994/1952] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:32 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:33.034635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:33.036848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:33.042814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:33.043299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:33.043739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:33.044435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:33.044889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:33.045314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:33.074018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b97a4c8a-c653-4a2e-93a7-922d7c1942f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043319 Sep 19 12:12:33.074562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 959/1953] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:33.854588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:33.855223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:33.859086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:33.859851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:33.862527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:33.863016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:33.863451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:33.864171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:33.864624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:33.865050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:33.866122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:33.866605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:33.867038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:33.867732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:33.868183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:33.868625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:34.056679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:34.059843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:34.065009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59a6723f-5a38-46ae-a619-60e9c78056e3 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.214310 Sep 19 12:12:34.065666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 995/1954] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:33 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:34.067648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf923cca-3a36-4c6e-bdfc-f2b985913b71 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.212917 Sep 19 12:12:34.068213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 960/1955] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:33 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:34.086727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:34.089161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:34.095758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:34.096243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:34.096683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:34.097387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:34.097868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:34.098294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:34.132442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-326edc02-9e82-4af5-af9a-a14cfaf49cf1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049398 Sep 19 12:12:34.133203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 996/1956] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:35.088684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:35.089658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:35.093692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:35.094344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:35.096732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:35.097223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:35.097683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:35.098397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:35.098882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:35.099312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:35.100660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:35.101146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:35.101590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:35.102314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:35.102770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:35.103199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:35.292511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:35.299286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:35.300274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b0f2210-0229-401a-9ae9-a24f7f204d60 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.211298 Sep 19 12:12:35.301222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 997/1957] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:35 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:35.307922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c0ff5f29-c00e-4912-b78c-2d606a45369d tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.223032 Sep 19 12:12:35.308639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 961/1958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:35 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:35.352561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:35.354882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:35.360769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:35.361243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:35.361676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:35.362388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:35.362834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:35.363254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:35.392879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b1ba3f2-5b75-4406-bbf1-1909cdc0dc88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090718 Sep 19 12:12:35.393421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 998/1959] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:36.324037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:36.324643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:36.331767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:36.332252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:36.332687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:36.333378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:36.333862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:36.334287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:36.335020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:36.335634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:36.342303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:36.343317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:36.343754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:36.344452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:36.344908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:36.345331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:36.537333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:36.540362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:36.545196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b5201a0-8ea5-476a-ac85-0f95b903c145 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.225030 Sep 19 12:12:36.545871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 962/1960] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:36 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:36.548561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75259e13-c98f-472b-800f-028eecd3330c tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.217335 Sep 19 12:12:36.549243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 999/1961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:36 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:36.550699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:36.552836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:36.558486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:36.558975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:36.559413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:36.560107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:36.560559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:36.560980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:36.590544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-855c6c62-26a0-49a9-a780-695d63ff2247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Sep 19 12:12:36.591099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 963/1962] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:37.569106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:37.569820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:37.570370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:37.571013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:37.575976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:37.576503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:37.576937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:37.577375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:37.577635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:37.577823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:37.578857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:37.578990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:37.579308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:37.579555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:37.580013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:37.580445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:37.774128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:37.777913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:37.781432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:37.782512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96965115-9210-4464-baec-a7248e06e4e5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.215831 Sep 19 12:12:37.783030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 964/1963] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:37 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:37.786278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7205336-8751-4d23-8897-082dc8fe4235 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.221221 Sep 19 12:12:37.786996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1000/1964] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:37 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:37.787676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:37.789965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:37.795699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:37.796194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:37.796603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:37.797887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:37.798339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:37.798758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:37.828107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-079d6edc-c4ee-4133-aeed-9816ab33c0b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Sep 19 12:12:37.828556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 965/1965] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:38.806358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:38.807074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:38.809389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:38.810248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:38.816100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:38.816583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:38.817010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:38.817523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:38.817734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:38.818205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:38.818339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:38.818509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:38.818667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:38.819186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:38.819644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:38.820072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:39.013835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:39.018317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:39.023218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-828d24a1-152a-48d2-bf05-8a47cafcfc65 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.221167 Sep 19 12:12:39.023795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1001/1966] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:38 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:39.026510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6298818-42ae-46ec-ab40-a403a97f8e1a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.220894 Sep 19 12:12:39.029885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 966/1967] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:38 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:39.030020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:39.030597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:39.036394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:39.036881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:39.037319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:39.038066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:39.038521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:39.038951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:39.067899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a47a1e4-61e6-4b79-a68b-3980f28edcf3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043138 Sep 19 12:12:39.068440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1002/1968] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:40.049679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:40.050321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:40.056655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:40.057134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:40.057571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:40.058291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:40.058744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:40.059170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:40.108374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:40.109077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:40.115144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:40.115722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:40.116247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:40.117010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:40.117538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:40.118065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:40.132804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:40.235696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:40.243632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-766a4fc2-2291-4718-82f2-ab52dc4295b4 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.197770 Sep 19 12:12:40.244286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1003/1969] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:40 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:40.248932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:40.251138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:40.256845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:40.257393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:40.257987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:40.258753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:40.259269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:40.259689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:40.278554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:40.287338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e68cd449-80da-4164-a09b-930074bffe04 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.245887 Sep 19 12:12:40.287907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 967/1970] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:40 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:40.290045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6adaf4db-3fa0-4f08-a190-0962fa4b7048 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Sep 19 12:12:40.290590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1004/1971] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:41.267840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:41.268467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:41.270586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:12:41.270735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 (ip 10.222.0.88) !!! Sep 19 12:12:41.277095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:41.277572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:41.278027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:41.278716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:41.279162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:41.279580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:41.302426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:41.304576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:41.311191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:41.311674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:41.312105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:41.313410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:41.313895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:41.314315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:41.347302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b741bdce-f20c-4256-81de-696ceb4d0337 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048769 Sep 19 12:12:41.348213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1005/1972] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:12:41.352849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:41.353540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:41.360836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:41.361464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:41.361948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:41.362653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:41.363104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:41.363526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:41.444060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:41.451619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3c21357c-4257-43da-9451-570256bb1189 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.188298 Sep 19 12:12:41.452192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 968/1973] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:41 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:41.509396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:41.517594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ab3009e-3356-4100-bb1e-51dbfbe39066 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.168778 Sep 19 12:12:41.518182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1006/1974] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:41 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:42.359883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:42.362157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:42.368496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:42.368971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:42.369399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:42.370113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:42.370560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:42.370976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:42.401732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de6510b1-9676-424a-93db-ceccb6375cc4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Sep 19 12:12:42.402304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 969/1975] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:42.476075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:42.476617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:42.483240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:42.483749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:42.484200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:42.484897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:42.485355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:42.485802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:42.546869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:42.547683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:42.555237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:42.555732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:42.556176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:42.556891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:42.557349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:42.557787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:42.659857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:42.667923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e2a110e-ae3e-4be5-bc82-fd3b4bf9381b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.195780 Sep 19 12:12:42.668572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1007/1976] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:42 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:42.714921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:42.723090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96c0a187-82ac-4a49-bcaa-a6124eafc3e7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.183233 Sep 19 12:12:42.723651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 970/1977] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:42 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:43.414778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:43.416919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:43.423575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:43.424056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:43.424490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:43.425178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:43.425626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:43.426186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:43.454244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d830704c-d4ea-4366-a83b-66922e23a7e3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Sep 19 12:12:43.454783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1008/1978] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:43.691307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:43.691920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:43.698401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:43.698889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:43.699330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:43.700029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:43.700482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:43.700910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:43.745944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:43.746557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:43.752818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:43.753293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:43.753985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:43.754671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:43.755117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:43.755534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:43.867939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:43.876060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3f28a932-81ed-4147-8712-ceea7a53c9dd tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.188644 Sep 19 12:12:43.876643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 971/1979] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:43 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:43.916438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:43.924687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-500262c3-97c0-4265-ad0d-0b0d25723996 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.182623 Sep 19 12:12:43.925242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1009/1980] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:43 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:44.466942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:44.469071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:44.474894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:44.475369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:44.475799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:44.476475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:44.476922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:44.477336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:44.506656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b12a6e26-e20f-40b3-9a86-7d3a91a56132 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044008 Sep 19 12:12:44.507187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 972/1981] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:44.899233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:44.899814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:44.906629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:44.907102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:44.907525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:44.908200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:44.908644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:44.909090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:44.947972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:44.948574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:44.955425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:44.955972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:44.956410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:44.957181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:44.957913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:44.958101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:45.088022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:45.096589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0bc215f7-fa6d-42cb-9fe1-4ba2b254fcf7 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.201164 Sep 19 12:12:45.097382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1010/1982] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:44 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:45.119514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:45.128141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f828611-4e1b-4726-8fa6-b4b0f4e3ecbd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.183921 Sep 19 12:12:45.128957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 973/1983] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:44 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:45.519402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:45.521608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:45.527534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:45.528017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:45.528451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:45.529140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:45.529593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:45.530124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:45.559321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b47011e-e67e-4448-ae61-9633816e5cd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044414 Sep 19 12:12:45.559865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1011/1984] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:46.120570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:46.121187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:46.123497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=72 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:46.130947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:46.130947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:46.130947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:46.130947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:46.131438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:46.131780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:46.151376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:46.151994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:46.159208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:46.159691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:46.160121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:46.160817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:46.161281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:46.161699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:46.337756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:46.344393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:46.346539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-91b0732e-a442-422b-9b56-b7e469fbfb68 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.229874 Sep 19 12:12:46.347633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 974/1985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:46 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:46.368227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18599a56-068c-4418-84cc-bb81bfd304a7 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.220703 Sep 19 12:12:46.369112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1012/1986] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:46 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:46.572356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:46.574557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:46.580450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:46.580932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:46.581369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:46.582092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:46.582547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:46.582978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:46.612576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b95b67c8-64fa-4a50-bb3d-9512950884e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044182 Sep 19 12:12:46.613129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 975/1987] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:47.371749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:47.372355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:47.379154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:47.379635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:47.380067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:47.380752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:47.381204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:47.381626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:47.392426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:47.393061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:47.399553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:47.400039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:47.400477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:47.401179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:47.401637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:47.402088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:47.584088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:47.588219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:47.594449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cc96a1a-fade-4160-b055-2f0b1167e4ba tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.225805 Sep 19 12:12:47.595150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1013/1988] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:47 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:47.597878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a1e2e23-9151-47be-862f-2dc1d8499f24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.209819 Sep 19 12:12:47.598448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 976/1989] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:47 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:47.624373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:47.626706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:47.632600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:47.633090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:47.633526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:47.634258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:47.634714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:47.635137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:47.665080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0e3e09a-88b6-49f7-9579-370345a66e19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Sep 19 12:12:47.665628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1014/1990] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:48.616819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:48.617426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:48.620393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:48.620999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:48.623307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=80 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:48.624155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:48.624595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:48.625056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:48.625930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:48.626383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:48.626832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:48.628569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:48.629059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:48.629499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:48.630243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:48.630697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:48.631121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:48.791388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:12:48.791593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 (ip 10.222.0.88) !!! Sep 19 12:12:48.823684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:48.826471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:48.831549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c8e9ac7-79ab-4065-9770-ccdd4c6edc2b tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.218704 Sep 19 12:12:48.832116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 977/1991] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:48 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:48.839286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8cf23cd8-0e50-4be6-a3bd-0dbb53f04dd2 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.218186 Sep 19 12:12:48.839286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1015/1992] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:48 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:48.839497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:48.839497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:48.845524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:48.846033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:48.846465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:48.847150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:48.847593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:48.848013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:48.878687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-849eaec3-c191-47e6-9e26-6ec4e347bf12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Sep 19 12:12:48.879242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 978/1993] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:49.855516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:49.856071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:49.857968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:49.858580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:49.862576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:49.863064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:49.863510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:49.864219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:49.864839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:49.864957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:49.865324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:49.865609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:49.865779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:49.866485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:49.866933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:49.867357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:49.958475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:12:49.958710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 (ip 10.222.0.88) !!! Sep 19 12:12:50.067195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:50.070905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:50.075470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6759dc9c-d203-429e-8f14-419ca03de503 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.221372 Sep 19 12:12:50.076041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 979/1994] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:49 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:50.081123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:50.083274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:50.084497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5e2bb29-db37-42cf-9d2b-d1aa12eda807 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.232898 Sep 19 12:12:50.085209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1016/1995] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:49 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:50.089165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:50.089651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:50.090117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:50.090819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:50.091326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:50.091752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:50.120292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94de7019-890d-45c1-93d7-29c6c2be1360 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Sep 19 12:12:50.120778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 980/1996] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:51.099260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:51.099873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:51.106399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:51.106889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:51.107328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:51.107452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:51.108021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:51.108139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:51.108476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:51.108900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:51.114321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:51.114801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:51.115238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:51.115933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:51.116391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:51.116818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:51.127610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:51.506675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:51.514873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:51.515045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e12fbba-9732-48e8-a6e9-b382c0721e33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.419586 Sep 19 12:12:51.515568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1017/1997] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:51 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:51.520151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:51.522519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:51.522731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5fbdfd50-cfd5-40aa-bfc3-1d96f1a11c7a tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.419056 Sep 19 12:12:51.523523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 981/1998] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:51 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:51.528371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:51.528858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:51.529296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:51.530018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:51.530594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:51.531023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:51.559769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-942ada6f-ec77-4691-8fde-861f3ba4fa37 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043226 Sep 19 12:12:51.560316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1018/1999] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:52.538144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:52.538762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:52.545392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:52.545890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:52.546316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:52.546316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:52.546524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:52.547029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:52.547485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:52.548040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:52.552576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:52.553061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:52.553493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:52.554210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:52.554669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:52.555088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:52.734828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:52.744149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3983e49-4588-4ab5-beea-ed2ace336074 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.209970 Sep 19 12:12:52.744454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:52.745227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 982/2000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:52 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:52.750008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:52.752730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:52.753209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb21cd36-1b14-432f-ae83-e56d5bff124f tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.210998 Sep 19 12:12:52.754024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1019/2001] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:52 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:52.758654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:52.759142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:52.759583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:52.760288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:52.760746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:52.761872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:52.790977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f41497bd-0cb9-4a6e-a8e7-0283080d5938 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Sep 19 12:12:52.791614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 983/2002] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:53.768112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:53.768716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:53.775141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:53.775625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:53.776057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:53.776324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:53.776781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:53.776942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:53.777194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:53.777618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:53.783829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:53.784315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:53.784775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:53.785457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:53.786019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:53.786451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:53.790747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:12:53.976631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:53.980323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:53.985123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41ce1c91-3960-48f5-89e5-5c54165cf6dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.221394 Sep 19 12:12:53.985748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1020/2003] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:53 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:53.988195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4648aa4b-e8a0-4b4b-9dfe-ae1bbfc6289c tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.215714 Sep 19 12:12:53.988925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 984/2004] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:53 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:53.990313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:53.992430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:53.998182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:53.998662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:53.999091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:53.999772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:54.000218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:54.000634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:54.030028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42e615e1-d484-499e-9446-f6ff29ef280f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Sep 19 12:12:54.030504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1021/2005] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:55.008331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:55.008945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:55.011330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:55.011939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:55.015429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:55.015913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:55.016349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:55.017049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:55.017501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:55.018451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:55.018812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:55.019301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:55.019733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:55.020457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:55.020914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:55.021341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:55.206345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:55.214842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0db3f735-bd8b-481e-a476-6a47d2e88298 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.210408 Sep 19 12:12:55.215424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 985/2006] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:55 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:55.219923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:55.220779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:55.223578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:55.230082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f151fe4-06a4-408a-b0b2-8862c2239c2d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.222510 Sep 19 12:12:55.230758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1022/2007] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:55 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:55.230906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:55.231478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:55.232127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:55.232856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:55.233313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:55.233734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:55.263213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-44b1bb69-ce52-4249-a4d2-41062f7f6b1d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046815 Sep 19 12:12:55.263762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 986/2008] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:56.247779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:56.248385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:56.253611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:56.254265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:56.256624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:56.257494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:56.258316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:56.259023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:56.259475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:56.260032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:56.260691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:56.261230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:56.261667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:56.262393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:56.262860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:56.263364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:56.399208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:56.407840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5311f0c6-34de-4d99-86e3-e7d6394a86ed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.164863 Sep 19 12:12:56.408414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1023/2009] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:56 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:56.413573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:56.415731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:56.421520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:56.422035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:56.422662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:56.423539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:56.424029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:56.424492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:56.453630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9508835-2cd0-4012-a418-aeba6b7708d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043615 Sep 19 12:12:56.454255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1024/2010] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:56.512017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:56.519987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ddc2e606-b086-4838-b00e-c9d37404db86 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.270343 Sep 19 12:12:56.520555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 987/2011] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:56 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:57.431305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:57.431918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:57.438276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:57.438759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:57.439195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:57.440518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:57.440976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:57.441402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:57.466738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:57.468947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:57.475374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:57.475859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:57.476292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:57.476984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:57.477436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:57.477884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:57.507788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5d699c1-1c98-4dc3-99f6-6d8fcd43d891 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045226 Sep 19 12:12:57.508578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 988/2012] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:12:57.543376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:57.543977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:57.550491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:57.550977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:57.551430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:57.552126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:57.552578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:57.553000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:57.568527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:57.576630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a3e38d5-ac94-4eb2-b6a8-08a707937f18 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149148 Sep 19 12:12:57.577128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1025/2013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:57 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:57.692065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:57.699878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c009099-cc57-44c9-9e00-d74e34afa5fb tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160398 Sep 19 12:12:57.700447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 989/2014] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:57 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:58.520836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:58.523045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:58.529343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:58.529874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:58.530305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:58.530984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:58.531435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:58.531847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:58.559617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e81c39a9-f488-407f-9ed0-2549b91293c5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Sep 19 12:12:58.560146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1026/2015] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:58.600011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:58.600614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:58.606417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:58.606893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:58.607321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:58.608009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:58.608453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:58.608870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:58.722571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:58.723175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:58.728976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:58.729449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:58.729912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:58.730595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:58.731778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:58.732224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:58.733471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:58.742017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c2fae13-6cdd-4bd7-8d05-54ab3bc16e24 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.145920 Sep 19 12:12:58.742784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 990/2016] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:58 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:12:58.859248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:58.867399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b17b6aea-aac4-48f1-8f24-1446017551f5 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148715 Sep 19 12:12:58.867957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1027/2017] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:58 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:12:59.571984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:59.574271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:59.580963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:59.581444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:59.581901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:59.582609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:59.583060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:59.583480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:59.613281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8c9f7fb9-7327-4a99-9de9-584e3e1c12f0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Sep 19 12:12:59.613936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 991/2018] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:12:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:12:59.765373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:59.765999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:59.772930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:59.773399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:59.773852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:59.774530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:59.774973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:59.775388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:59.890808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:12:59.891518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:12:59.897522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:59.898138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:59.898568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:59.899251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:12:59.899696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:12:59.900110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:12:59.904028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:12:59.912576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e15e76a2-a51c-4321-bf6e-9c1cdee9e62f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.151048 Sep 19 12:12:59.913142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1028/2019] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:59 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:00.027051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:00.035191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9e96cb3d-286c-4ced-a1ca-202f4f76387d tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.148290 Sep 19 12:13:00.035761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 992/2020] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:12:59 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:00.625782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:00.628465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:00.634446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:00.634922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:00.635354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:00.636042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:00.636493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:00.636916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:00.665918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94b1f76b-c4b0-49ad-b750-313bb5644c70 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Sep 19 12:13:00.666467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1029/2021] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:13:00.935241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:00.935856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:00.942926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:00.943414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:00.943853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:00.944551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:00.945008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:00.945436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:01.058780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:01.059393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:01.066403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:01.066891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:01.067322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:01.068014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:01.068474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:01.068894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:01.075339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:01.083386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-496867a3-e82a-47dd-822f-bea9a09af579 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.152026 Sep 19 12:13:01.083997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 993/2022] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:00 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:01.198072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:01.205573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4b406fb-06fe-4007-b068-bf635cd7a568 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.150625 Sep 19 12:13:01.206163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1030/2023] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:01 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:01.678543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:01.680757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:01.686822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:01.687300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:01.687734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:01.688418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:01.688868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:01.689288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:01.718064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-16795d80-0291-43a6-83b3-c69a0ce84c83 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043481 Sep 19 12:13:01.718614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 994/2024] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:13:02.106735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:02.107339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:02.113590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:02.114099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:02.114530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:02.115211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:02.115655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:02.116093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:02.228598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:02.229300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:02.235750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:02.236230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:02.236753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:02.237455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:02.237936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:02.238360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:02.246919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:02.257097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4775d678-d845-413e-a20c-ef897cfa049f tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.153973 Sep 19 12:13:02.258111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1031/2025] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:02 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:02.372244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:02.380601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-549e1cbf-1386-4a5a-afa6-4ba152195c4e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.156022 Sep 19 12:13:02.381164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 995/2026] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:02 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:02.730695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:02.732790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:02.739312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:02.739788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:02.740218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:02.740897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:02.741345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:02.741787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:02.771129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-722e3e86-9cbc-48ca-a87d-4de387916706 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Sep 19 12:13:02.771671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1032/2027] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:13:03.281672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:03.282348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:03.289471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:03.289997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:03.290441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:03.291142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:03.291598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:03.292026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:03.403937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:03.404548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:03.411476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:03.411964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:03.412400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:03.413099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:03.413546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:03.413995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:03.421596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:03.432692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-821c632e-5693-4869-a737-c4b4236d545e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.154850 Sep 19 12:13:03.433472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 996/2028] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:03 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:03.552440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:03.560143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aee4af74-4a18-4194-9199-0db5d4440332 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.160648 Sep 19 12:13:03.560706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1033/2029] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:03 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:03.783507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:03.785670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:03.791563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:03.792045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:03.792481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:03.793170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:03.793625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:03.794083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:03.822832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0f7ac50a-1d0f-4c25-9790-941658220bc1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043301 Sep 19 12:13:03.823373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 997/2030] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:13:04.455502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:04.456115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:04.462461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:04.462945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:04.463388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:04.464334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:04.464817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:04.465213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:04.469149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:04.583774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:04.584378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:04.590892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:04.591380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:04.591807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:04.592495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:04.592943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:04.593360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:04.593588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:04.602300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e68a5770-d654-40d3-ab5e-370e30457eed tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150572 Sep 19 12:13:04.602875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1034/2031] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:04 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:04.730615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:04.738309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3f33a845-a7ef-48fc-9b59-bff2e6bd1ebe tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.158389 Sep 19 12:13:04.738873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 998/2032] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:04 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:04.835677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:04.837859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:04.843953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:04.844432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:04.844862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:04.845549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:04.846658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:04.847082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:04.875499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b519e64-ba5e-492f-9497-767364f42402 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Sep 19 12:13:04.876037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1035/2033] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:13:05.626050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:05.626661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:05.633700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:05.634212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:05.634676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:05.635369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:05.635818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:05.636240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:05.761511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:05.761670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:05.762282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] [instance: 4153682a-ad93-4f2a-ae86-2e343258d773] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:05.768744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:05.769229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:05.769666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:05.769803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f91a10da-a0e2-433e-a169-ef001b407130 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.147581 Sep 19 12:13:05.770298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 999/2034] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:05 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:05.770462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:05.770913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:05.771424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:05.887252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:05.889559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:05.895468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:05.895942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:05.896384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:05.897082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:05.897540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:05.897995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:05.900060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc84618366b045658728196980072790', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd7174903460989484c1ab233208a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:05.907657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e30148ff-add0-40f8-add0-5fefef34a5a3 tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773" status: 200 len: 1266 microversion: 2.1 time: 0.149766 Sep 19 12:13:05.908701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1036/2035] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:05 2022] GET /compute/v2.1/servers/4153682a-ad93-4f2a-ae86-2e343258d773 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:05.923165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:05.928915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-acb5bd62-4da0-483e-bed1-cee29a9e67f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Sep 19 12:13:05.929491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1000/2036] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:13:06.792195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:06.792804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:06.798848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:06.799327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:06.799791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:06.800509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:06.800959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:06.801377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:06.930455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:06.938590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-22fd751e-3a8b-4ce0-a3e1-6c4bc550e275 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.150213 Sep 19 12:13:06.939147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1037/2037] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:06 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:06.941483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:06.943704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:06.950096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:06.950583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:06.951023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:06.951718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:06.952173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:06.952601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:06.981361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1040f682-c6ba-44a0-aa98-fa84342a8ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044845 Sep 19 12:13:06.981935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1001/2038] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:13:07.962250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:07.962791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:07.969357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:07.969869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:07.970306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:07.971627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:07.972078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:07.972501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:07.993693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:07.995909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:08.002937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:08.003424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:08.003865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:08.004570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:08.005029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:08.005459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:08.035540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-461e48c3-f2bb-43b7-890e-be1a80cd8476 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045751 Sep 19 12:13:08.036184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1002/2039] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:13:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:13:08.100043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:08.108186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ad96887-eee2-467f-b94d-1d7115a4476e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.149946 Sep 19 12:13:08.108750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1038/2040] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:07 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:09.048058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:13:09.050325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:09.056711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:09.057199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:09.057636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:09.058357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:09.058815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:09.059268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:09.086924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [d47fb8ce-a898-4ed6-9b96-b777e15ba91e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:13:09.130741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:09.131344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:09.137794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:09.138269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:09.138695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:09.139374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:09.139816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:09.140234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:09.274932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:09.283180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a385050-22a9-41cc-adaf-e2a5b3647ecc tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.156927 Sep 19 12:13:09.283745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1039/2041] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:09 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:10.094423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [d47fb8ce-a898-4ed6-9b96-b777e15ba91e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 49436. Sep 19 12:13:10.154368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8291c6e1-db86-4adc-852d-48327b4557ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/action" status: 200 len: 76616 microversion: 2.1 time: 1.110241 Sep 19 12:13:10.155033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1003/2042] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 12:13:09 2022] POST /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27/action => generated 76616 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:13:10.305942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:10.306694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: ce686f0f-5a79-48d6-8501-d6f8e781ad39] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:10.313192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:10.313672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:10.314131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:10.314821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:10.315271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:10.315696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:10.439795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:10.447904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0dbac0ff-ff67-4639-8239-ab5c802d895e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39" status: 200 len: 1736 microversion: 2.1 time: 0.145851 Sep 19 12:13:10.448447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1040/2043] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:10 2022] GET /compute/v2.1/servers/ce686f0f-5a79-48d6-8501-d6f8e781ad39 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:10.470290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ea1b5ef-6420-4302-819d-1a901ac50980 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '.version_select at 0x7f4ff9a149d0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:10.496588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ea1b5ef-6420-4302-819d-1a901ac50980 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991500285" status: 202 len: 0 microversion: 2.1 time: 0.030535 Sep 19 12:13:10.497166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1004/2044] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Sep 19 12:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991500285 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:13:10.856534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:10.857033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:10.863056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:10.863542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:10.863977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:10.864675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:10.865134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:10.865577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:10.901341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:13:10.965894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [a36e9fb9-6a96-42be-8113-415e04de5bb0] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:13:11.519185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-d7e79112-23ec-4197-988f-5b43a62d02c5 req-e77888df-0a35-4af8-9f5a-8dd7cb1249ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce686f0f-5a79-48d6-8501-d6f8e781ad39", "tag": "dd4f044e-c20a-4016-921a-f989ecfd24b9"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:13:11.531143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-d7e79112-23ec-4197-988f-5b43a62d02c5 req-e77888df-0a35-4af8-9f5a-8dd7cb1249ef service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:11.531901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-d7e79112-23ec-4197-988f-5b43a62d02c5 req-e77888df-0a35-4af8-9f5a-8dd7cb1249ef service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:11.532395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-d7e79112-23ec-4197-988f-5b43a62d02c5 req-e77888df-0a35-4af8-9f5a-8dd7cb1249ef service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:11.544780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-d7e79112-23ec-4197-988f-5b43a62d02c5 req-e77888df-0a35-4af8-9f5a-8dd7cb1249ef service nova] Creating event network-changed:dd4f044e-c20a-4016-921a-f989ecfd24b9 for instance ce686f0f-5a79-48d6-8501-d6f8e781ad39 on hv-cinder-85829 Sep 19 12:13:11.550809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-d7e79112-23ec-4197-988f-5b43a62d02c5 req-e77888df-0a35-4af8-9f5a-8dd7cb1249ef service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103354 Sep 19 12:13:11.551989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1005/2045] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:13:11.975836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [a36e9fb9-6a96-42be-8113-415e04de5bb0] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 49476. Sep 19 12:13:12.021370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a07fed5c-7f7e-476d-b156-4b24ee94122b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "DELETE /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 204 len: 0 microversion: 2.1 time: 1.168532 Sep 19 12:13:12.023929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1041/2046] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:13:10 2022] DELETE /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 0 bytes in 1172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:13:12.042686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:12.043421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:12.060600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:12.061482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:12.062205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:12.065269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:12.066514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:12.067468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:12.095466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-6acd8ac5-606c-4261-83db-0b518151bb76 req-1842c1f2-408c-48af-8e03-e9e6f43f3253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4153682a-ad93-4f2a-ae86-2e343258d773", "name": "network-vif-deleted", "tag": "ef44d266-e681-4d11-a178-ca3523c5f42c"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:13:12.109321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6acd8ac5-606c-4261-83db-0b518151bb76 req-1842c1f2-408c-48af-8e03-e9e6f43f3253 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:12.110922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6acd8ac5-606c-4261-83db-0b518151bb76 req-1842c1f2-408c-48af-8e03-e9e6f43f3253 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:12.112500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6acd8ac5-606c-4261-83db-0b518151bb76 req-1842c1f2-408c-48af-8e03-e9e6f43f3253 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:12.127798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.compute.server_external_events [req-6acd8ac5-606c-4261-83db-0b518151bb76 req-1842c1f2-408c-48af-8e03-e9e6f43f3253 service nova] Unable to find a host for instance 4153682a-ad93-4f2a-ae86-2e343258d773. Dropping event network-vif-deleted {{(pid=120644) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 12:13:12.128894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-6acd8ac5-606c-4261-83db-0b518151bb76 req-1842c1f2-408c-48af-8e03-e9e6f43f3253 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.199294 Sep 19 12:13:12.130781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1006/2047] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 202 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 19 12:13:12.253002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:12.261452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eac549dd-4e2f-438e-83ed-a4636df38a18 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223063 Sep 19 12:13:12.262579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1042/2048] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:12 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:13.286198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:13.286922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:13.293280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:13.293750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:13.294208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:13.294888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:13.295332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:13.295746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:13.431067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:13.439577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0869c78f-e96c-4186-b0ee-cf9c1c79b909 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.157732 Sep 19 12:13:13.440152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1007/2049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:13 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:14.461753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:14.462384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:14.468981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:14.469465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:14.469931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:14.471261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:14.471710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:14.472124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:14.598121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:14.606208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63123a53-d5f8-4590-9893-51fc234c5bc1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.148329 Sep 19 12:13:14.606763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1043/2050] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:14 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:15.629557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:15.630131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:15.636791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:15.637306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:15.637790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:15.638499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:15.638983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:15.639410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:15.765066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:15.773424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-00044a84-9936-4920-a812-1a8cb31b1546 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.147870 Sep 19 12:13:15.774019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1008/2051] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:15 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:16.796253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:16.796854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:16.803674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:16.804145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:16.804573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:16.805348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:16.805815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:16.806230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:16.936455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:16.945270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac772bfd-b907-48ab-acc1-b9522df83167 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.152864 Sep 19 12:13:16.945847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1044/2052] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:16 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:17.968442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:17.969054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:17.972016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:17.977189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:17.977675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:17.978141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:17.978835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:17.979290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:17.979716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:18.104783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:18.113051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7f3bc50-61bd-4686-bf07-0792674f8836 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.148428 Sep 19 12:13:18.113683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1009/2053] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:17 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:19.137269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:19.137908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:19.140460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:19.146309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:19.146795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:19.147232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:19.147926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:19.148385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:19.149037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:19.281845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:19.290050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35efe0cf-3299-4080-9ca5-037f5d2d979a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156686 Sep 19 12:13:19.290606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1045/2054] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:19 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:20.313430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:20.314561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:20.320833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:20.321312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:20.321737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:20.322450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:20.322894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:20.323311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:20.454866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:20.462913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-937398f1-8f11-4f5c-b484-e85c8cd614a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.153306 Sep 19 12:13:20.463478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1010/2055] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:20 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:21.485521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:21.486152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:21.492655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:21.493128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:21.493571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:21.494275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:21.494722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:21.495140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:21.624331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:21.633010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd3db0de-42fc-4d57-8ff6-fcad76d67596 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.151252 Sep 19 12:13:21.633574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1046/2056] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:21 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:22.656558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:22.657204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:22.664562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:22.665057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:22.665496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:22.666221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:22.666724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:22.667104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:23.012161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:23.021064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2879118c-28a6-4666-88b8-c1fd7fb36e98 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.368582 Sep 19 12:13:23.021633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1011/2057] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:22 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:24.044126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:24.044794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:24.051692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:24.052161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:24.052584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:24.053257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:24.053700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:24.054142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:24.181163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:24.190390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aadaf301-f88d-40eb-8a34-2664249ebbde tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.149791 Sep 19 12:13:24.191242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1047/2058] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:24 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:25.214374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:25.215007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:25.221408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:25.221927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:25.222369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:25.223065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:25.223521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:25.223948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:25.351651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:25.359769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92265d7e-3384-4cd5-8a8b-2b6c88e4d298 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.149584 Sep 19 12:13:25.360348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1012/2059] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:25 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:26.385685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:26.386686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:26.393388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:26.393910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:26.394555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:26.395254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:26.395706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:26.396133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:26.527870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:26.539742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-207533a5-51e6-47b6-a460-bf3f5895c6a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.159833 Sep 19 12:13:26.540301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1048/2060] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:26 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:27.564500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:27.565182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:27.572479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:27.572965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:27.573403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:27.574148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:27.574603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:27.575031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:27.709345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:27.718623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f76aead-3002-410c-8631-017aae25165d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.159262 Sep 19 12:13:27.719200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1013/2061] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:27 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:28.742210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:28.742782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:28.749188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:28.749671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:28.750138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:28.750826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:28.751277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:28.751701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:28.755744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:28.879288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:28.887499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68404f4e-a279-471b-99ce-6f24da65d3da tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.149213 Sep 19 12:13:28.888067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1049/2062] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:28 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:29.911062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:29.911673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:29.918076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:29.918562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:29.918999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:29.919693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:29.920147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:29.920572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:30.056448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:30.064625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-44f8ae16-7afc-41c0-b9c4-7a334bca5a55 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.158004 Sep 19 12:13:30.065190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1014/2063] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:29 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:31.087831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:31.088437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:31.095161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:31.095644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:31.096072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:31.096751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:31.097199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:31.097618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:31.222060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:31.232866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e911cd8b-5d33-4322-9ecf-afe0f8188f5a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.148822 Sep 19 12:13:31.233436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1050/2064] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:31 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:32.256353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:32.256919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:32.263366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:32.263855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:32.264295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:32.264996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:32.265451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:32.265905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:32.398788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:32.406845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0df21330-7544-4ce5-83cc-f8b41c09ad1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.154435 Sep 19 12:13:32.408032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1015/2065] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:32 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:33.430841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:33.431488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:33.437846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:33.438327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:33.438762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:33.439450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:33.439902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:33.440328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:33.580407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:33.588966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-649e89ca-156f-4cc8-9829-75eba18594c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.161798 Sep 19 12:13:33.589531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1051/2066] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:33 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:34.612290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:34.612929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:34.619490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:34.619977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:34.620411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:34.621104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:34.621553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:34.622127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:34.748408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:34.757283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b576bd3-c295-4aac-b968-f56cd502235b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.149320 Sep 19 12:13:34.757872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1016/2067] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:34 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:35.780448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:35.781050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:35.788001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:35.788476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:35.788908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:35.789596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:35.790074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:35.790496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:35.919698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:35.928499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adc4caa0-d4e8-4c23-b214-d95c59e116c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.151927 Sep 19 12:13:35.929080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1052/2068] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:35 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:36.951619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:36.952220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:36.959158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:36.959629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:36.960059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:36.960736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:36.961180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:36.961641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:36.965725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=82 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:37.087871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:37.096794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a73739d-8114-4f29-a9ff-7ab260303c53 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.149054 Sep 19 12:13:37.097355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1017/2069] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:36 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:38.119724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:38.120338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:38.126501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:38.126987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:38.127427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:38.128118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:38.128573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:38.128995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:38.253562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:38.261704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4216de5f-4e77-47ae-862f-a20fa9b79345 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.145919 Sep 19 12:13:38.262309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1053/2070] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:38 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:39.284839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:39.285383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:39.291796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:39.292279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:39.292712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:39.293399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:39.293868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:39.294292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:39.433316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:39.442237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0962cf17-8e6a-48c4-9468-c1a33702b15b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.161344 Sep 19 12:13:39.442795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1018/2071] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:39 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:40.465338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:40.466002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:40.472506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:40.472991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:40.473429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:40.474153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:40.474602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:40.475029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:40.601097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:40.609280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-064fa4b7-c033-47e3-a6c9-99d0abffdb8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.148038 Sep 19 12:13:40.610742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1054/2072] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:40 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:41.632602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:41.633205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:41.639603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:41.640076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:41.640502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:41.641214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:41.641658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:41.642100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:41.770310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:41.778385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92504820-76b5-4a3b-b3d3-c8fd74d1b132 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.149601 Sep 19 12:13:41.778949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1019/2073] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:41 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:42.585730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:42.586261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:42.593027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:42.593507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:42.593978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:42.594675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:42.595131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:42.595557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:42.619854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:13:42.698024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b466506d-bca1-4dbd-b4fb-b290a00d08f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 204 len: 0 microversion: 2.20 time: 0.114602 Sep 19 12:13:42.698889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1055/2074] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Sep 19 12:13:42 2022] DELETE /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:13:42.708067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:42.708714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:42.715433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:42.715922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:42.716386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:42.717085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:42.717539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:42.717993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:42.802477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:42.803180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:42.809050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:42.809529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:42.810021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:42.810715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:42.811161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:42.811583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:42.850560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:42.870171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:42.871619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:42.872790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-be62cbbf-a7fe-46fb-9995-6b31de0afeb1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.169435 Sep 19 12:13:42.873353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1020/2075] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:42.944927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:42.953091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-832982f2-c344-4889-86b2-f43118fb36a2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.154910 Sep 19 12:13:42.953651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1056/2076] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:42 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:43.900180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:43.900575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:43.906680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:43.907163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:43.907601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:43.908877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:43.909330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:43.909776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:43.977496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:43.978752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:43.985928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:43.986414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:43.986851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:43.987554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:43.988406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:43.988406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:44.073154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:44.085148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:44.087230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:44.089282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db303e9e-02a2-453a-a7e2-f1be3440a001 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.193357 Sep 19 12:13:44.098279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1021/2077] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:44.142263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:44.153043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c0125b0e-4180-4df7-b7dd-e30695ffd21a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.179455 Sep 19 12:13:44.153631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1057/2078] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:43 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:45.115666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:45.116306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:45.122847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:45.123326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:45.123790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:45.124482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:45.124971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:45.125372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:45.179283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:45.180560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:45.187550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:45.188279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:45.188862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:45.189569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:45.190065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:45.190486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:45.305976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:45.314867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:45.316834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:45.318163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0639f7b3-5776-495a-a56e-0d83189c9e47 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.206381 Sep 19 12:13:45.318733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1022/2079] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:45.355363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:45.364504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-150869e6-64a8-4b14-a484-bbb15d0c9035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.189371 Sep 19 12:13:45.365249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1058/2080] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:45 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:46.348625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:46.349616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:46.356520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:46.357002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:46.357431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:46.358144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:46.358592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:46.359014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:46.388010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:46.388596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:46.395424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:46.395931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:46.396366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:46.397110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:46.397510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:46.397967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:46.561405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:46.570812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:46.572264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:46.573450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0805ce17-0839-4fe2-8b07-60b7a52a1817 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.229491 Sep 19 12:13:46.574077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1023/2081] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:46.585629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:46.596655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5c845cd-a7a0-4534-bfee-94fdf13df4d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211582 Sep 19 12:13:46.597462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1059/2082] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:46 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:47.599657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:47.600270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:47.606685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:47.607167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:47.607604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:47.608297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:47.608754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:47.609180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:47.620012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:47.620628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:47.627849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:47.628414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:47.628855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:47.629555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:47.630068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:47.630496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:47.807094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:47.814212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:47.815881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:47.817502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:47.818709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5b0922f-c57d-4392-b139-4db7d82a8211 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.223004 Sep 19 12:13:47.819267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1024/2083] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:47.822480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-501d08e2-3a24-4d7a-b869-c5fb7fdb4ff0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.206335 Sep 19 12:13:47.823041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1060/2084] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:47 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:48.843982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:48.844561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:48.844951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:48.846204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:48.847353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=32 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:48.852533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:48.852701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:48.853021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:48.853211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:48.853462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:48.853588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:48.854183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:48.854298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:48.854636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:48.854743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:48.855058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:48.855177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:49.044010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:49.050944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:49.052710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:49.054172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:49.055337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60d5bacb-0f4d-4386-9ed6-4fbbbb38e432 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215383 Sep 19 12:13:49.055897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1025/2085] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:49.059312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d211cd34-b72e-4885-b18b-9a5facca60f1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.218085 Sep 19 12:13:49.059872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1061/2086] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:48 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:50.080983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:50.081593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:50.083058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:50.083794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:50.086201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:50.088095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:50.088650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:50.089342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:50.090069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:50.090523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:50.090948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:50.092160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:50.092640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:50.093067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:50.093752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:50.094215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:50.094634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:50.282206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:50.286280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:50.291233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:50.292733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:50.293957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a02a2bf9-499e-440a-b42d-154ab6782030 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217601 Sep 19 12:13:50.294520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1026/2087] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:50.294645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1aa3e2d-cbf0-4977-91af-d391cc73c979 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216540 Sep 19 12:13:50.295199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1062/2088] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:50 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:51.317659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:51.318301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:51.319387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:51.320030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:51.324470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:51.324952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:51.325386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:51.326110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:51.326325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:51.326559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:51.326809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:51.326982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:51.327243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:51.327938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:51.328391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:51.328816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:51.518550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:51.525260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:51.527195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-325a8d42-742f-49e1-a538-4a7871f2ab7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.213426 Sep 19 12:13:51.528030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1027/2089] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:51 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:51.535099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:51.536461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:51.537620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd8f0001-ee15-48dc-abd0-c2068633c974 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.222059 Sep 19 12:13:51.538216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1063/2090] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:13:52.550494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:52.551111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:52.557534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:52.558132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:52.558804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:52.559513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:52.560001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:52.560437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:52.562977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:52.563589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:52.570819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:52.571293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:52.571725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:52.572423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:52.572875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:52.573296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:52.596741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:52.761313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:52.764335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:52.770765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9dfe39ee-6e6c-4140-8df2-31889d4e6cfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.224090 Sep 19 12:13:52.771598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1028/2091] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:52 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:52.777697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:52.779480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:52.780659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fec80dd4-14cc-44c6-959a-585eca4806d1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221491 Sep 19 12:13:52.781300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1064/2092] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:13:53.794948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:53.795566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:53.801981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:53.802469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:53.802907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:53.803641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:53.804104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:53.804532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:53.806665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:53.807386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:53.814580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:53.815061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:53.815485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:53.816166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:53.816606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:53.817020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:53.998409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:54.002784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:54.007246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1dcf12d5-a96b-46ca-96c9-8773d21a7fb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216132 Sep 19 12:13:54.007820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1029/2093] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:53 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:54.011535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:54.012995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:54.014162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24e84716-c564-4edb-a5b1-99ac003cdd74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.211384 Sep 19 12:13:54.014917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1065/2094] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:13:55.031295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:55.031899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:55.039028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:55.039511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:55.039939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:55.040187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:55.040624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:55.040743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:55.041068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:55.041487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:55.046934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:55.047418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:55.047857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:55.048551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:55.049003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:55.049464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:55.234719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:55.237517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:55.243098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7108ede-b048-4252-a0ff-3bcb2e169455 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215596 Sep 19 12:13:55.243670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1030/2095] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:55 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:55.246097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:55.247535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:55.248685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fe7501e-61ec-44e2-9a61-5da478c8311e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212659 Sep 19 12:13:55.249232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1066/2096] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:13:56.274278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:56.274882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:56.281084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:56.281567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:56.282036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:56.283216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:56.283663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:56.284084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:56.391594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:56.392781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:56.398675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:56.399226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:56.399655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:56.400359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:56.400996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:56.401415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:56.422655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:56.431274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:56.432733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:56.433928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f7f0005-c2e6-4438-bb80-b5663d1f22ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.163559 Sep 19 12:13:56.434485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1067/2097] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:13:56.531596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:56.540405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d72f0cd4-38bc-4a94-b062-95539f212299 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.277740 Sep 19 12:13:56.540974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1031/2098] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:56 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:13:57.458630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:57.459267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:57.465878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:57.466361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:57.466795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:57.467474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:57.467921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:57.468342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:57.563964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:57.564690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:57.571178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:57.571737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:57.572246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:57.573033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:57.573564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:57.574088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:57.598414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:57.607176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:57.608644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:57.609873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5055533c-2468-4361-88b9-e239ec0accbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155116 Sep 19 12:13:57.610364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1068/2099] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:57.702533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:57.714149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bd07ee47-4e37-492f-bd0c-47611d1c65e9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.153691 Sep 19 12:13:57.714724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1032/2100] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:57 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:58.635525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:58.636133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:58.642559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:58.643044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:58.643481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:58.644171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:58.644618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:58.645043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:58.738193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:58.738801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:58.744770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:58.745247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:58.745673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:58.746396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:58.746836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:58.747252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:58.773969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:58.782677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:58.784126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:58.785297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acd772be-faec-4942-9171-bd2470ebd303 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.153675 Sep 19 12:13:58.797786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1069/2101] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:13:58.871553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:58.873758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:13:58.881583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7a66a59-303e-46df-9576-ffc8ad194b16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.147866 Sep 19 12:13:58.882178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1033/2102] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:58 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:13:59.811999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:59.812610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:59.819619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:59.820103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:59.820542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:59.821228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:59.821681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:59.822124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:59.904429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:13:59.905050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:13:59.911674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:59.912168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:59.912608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:59.913307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:13:59.913780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:13:59.914212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:13:59.963347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:59.972670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:59.974129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:13:59.976159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-828cdef2-5559-4141-8e47-21c5518cbe2e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.167242 Sep 19 12:13:59.976159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1070/2103] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:13:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:00.052261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:00.060527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-423c5d3f-87a2-4ff5-9622-453727062e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.159928 Sep 19 12:14:00.061087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1034/2104] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:13:59 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:01.001470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:01.001936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:01.008024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:01.008503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:01.008932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:01.009623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:01.010100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:01.010518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:01.085637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:01.086556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:01.095478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:01.096729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:01.097430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:01.098536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:01.099080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:01.099569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:01.150968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:01.160228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:01.161652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:01.162861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e43a5654-04e0-4875-be34-d7be68005f9e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.165815 Sep 19 12:14:01.163626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1071/2105] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:01.236582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:01.245181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7196971-96cc-4d9d-ab93-cf607909f6cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.164658 Sep 19 12:14:01.245752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1035/2106] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:01 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:02.188996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:02.189606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:02.195950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:02.196428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:02.196866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:02.197558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:02.198038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:02.198466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:02.268260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:02.268879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:02.275297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:02.275853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:02.276375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:02.277156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:02.277612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:02.278115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:02.339200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:02.348570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:02.350022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:02.351165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1466d327-978e-498a-8f23-6c21e401ba3e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.166577 Sep 19 12:14:02.351715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1072/2107] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:02.422960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:02.431324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e595388-ccaa-4cc7-a9ea-b44d8e445926 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.166862 Sep 19 12:14:02.431926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1036/2108] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:02 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:03.376115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:03.376727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:03.383300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:03.383791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:03.384208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:03.384886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:03.385332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:03.385752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:03.453599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:03.454933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:03.461385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:03.461981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:03.462422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:03.463117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:03.463588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:03.464245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:03.522044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:03.530593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:03.532057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:03.533210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e62fbc92-5ca1-4c19-8d33-bf8ef4a0509d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.160907 Sep 19 12:14:03.533785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1073/2109] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:03.602642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:03.610983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-898d143d-8b9d-43d1-977c-d4ca7d43d78c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.161165 Sep 19 12:14:03.611491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1037/2110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:03 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:04.558544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:04.559146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:04.565510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:04.566022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:04.566454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:04.567134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:04.567585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:04.568006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:04.633951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:04.634564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:04.641055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:04.642067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:04.642498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:04.643182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:04.643625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:04.644040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:04.728156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:04.736971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:04.738456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:04.739614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0cf43ab-85b4-4a64-b9d9-e643c13ccc8f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.184993 Sep 19 12:14:04.740173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1074/2111] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:04.786693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:04.794806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-68043e4c-c940-46e9-8a29-ada0589e3a22 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.164731 Sep 19 12:14:04.795373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1038/2112] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:04 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:05.764867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:05.765492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:05.771787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:05.772267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:05.772730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:05.773424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:05.773908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:05.774337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:05.818033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:05.818746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:05.825292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:05.825874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:05.826372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:05.827126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:05.827664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:05.828088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:05.956872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:05.965642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:05.967101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:05.968239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ad69369-26ad-4949-8a02-0d9588457076 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.207389 Sep 19 12:14:05.968788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1075/2113] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:05.983212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:05.991988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fc2ffdc2-56a4-4fdf-bbf9-fdd8a35af4d0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.177827 Sep 19 12:14:05.992543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1039/2114] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:05 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:06.994048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:06.994649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:07.000689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:07.001773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:07.002221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:07.002894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:07.003337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:07.003754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:07.015126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:07.015814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:07.022154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:07.022632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:07.023066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:07.023756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:07.024216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:07.024641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:07.195295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:07.203772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:07.205207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:07.205887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:07.206400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8fdfb517-ab78-4cad-8f9a-33d05a51f3cc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216268 Sep 19 12:14:07.206953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1076/2115] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:07.214674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0da5d8dc-f2ab-465d-9b57-a4899b5811bc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.203388 Sep 19 12:14:07.215236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1040/2116] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:07 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:08.232073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:08.232683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:08.238359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:08.238972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:08.239465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:08.239951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:08.240421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:08.241136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:08.241586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:08.242037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:08.245311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:08.245815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:08.246256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:08.246950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:08.247408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:08.247832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:08.435825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:08.440607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:08.445208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:08.446807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:08.448097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-902f3933-ceae-4442-b7a4-1cd7890284e3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.219898 Sep 19 12:14:08.448680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1077/2117] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:08.448820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f86237a-2382-4199-a5b8-1bac96b7f8e3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214190 Sep 19 12:14:08.449364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1041/2118] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:08 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:09.473673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:09.474147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:09.474513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:09.474615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:09.480758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:09.480927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:09.481244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:09.481373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:09.481673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:09.481817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:09.482386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:09.482499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:09.482831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:09.482958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:09.483249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:09.483361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:09.678700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:09.683285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:09.687599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:09.689042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:09.690245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-168e779a-3b36-4b4a-9d7d-a29663f88d5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.220880 Sep 19 12:14:09.690987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1042/2119] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:09.707480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1fc83cc1-b589-4e22-8d02-ca3951ef5284 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.238031 Sep 19 12:14:09.708358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1078/2120] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:09 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:10.722474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:10.723064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:10.730725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:10.731216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:10.731757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:10.732232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:10.732864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:10.733032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:10.733198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:10.733331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:10.739730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:10.740208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:10.740635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:10.741321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:10.741979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:10.742554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:10.930412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:10.934690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:10.939815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:10.941290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:10.942482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0644867d-7562-4a30-9a7f-72a7562232b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.224011 Sep 19 12:14:10.943048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1043/2121] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:10.943495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09126b30-19fd-4335-a33e-4781deb619c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215777 Sep 19 12:14:10.944042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1079/2122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:10 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:11.966754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:11.967297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:11.967699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:11.968331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:11.974020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:11.974490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:11.974622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:11.974931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:11.975053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:11.975385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:11.975623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:11.976079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:11.976220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:11.976503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:11.976621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:11.977030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:12.378819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:12.381918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:12.385030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:12.388808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:12.390296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:12.390880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c8c2c9e8-6d99-4b66-9a25-8c28f2ff2491 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.428352 Sep 19 12:14:12.391448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3467b56e-bee1-4823-837b-f2424efefae2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.427908 Sep 19 12:14:12.391639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1044/2123] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:11 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:12.391980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1080/2124] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:13.414193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:13.414803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:13.416155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:13.416772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:13.421260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:13.421739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:13.422203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:13.422896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:13.423344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:13.423765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:13.423872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:13.424246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:13.424683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:13.425376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:13.425850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:13.426279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:13.615854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:13.620506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:13.624561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b2d095b-33ba-44c0-a6f2-f12b6fe5837b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214192 Sep 19 12:14:13.625140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1045/2125] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:13 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:13.629551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:13.631018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:13.632166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-427cdb3b-ff27-4d0f-a089-dcf2adbaef31 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.219868 Sep 19 12:14:13.632708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1081/2126] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:14.648791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:14.649316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:14.655821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:14.656208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:14.656622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:14.657391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:14.657492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:14.658011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:14.658456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:14.658873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:14.663740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:14.664261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:14.664693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:14.665381 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:14.665857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:14.666285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:14.861421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:14.864558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:14.870211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e22cebec-7183-4277-a457-f3a2c27a0145 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.225352 Sep 19 12:14:14.871095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1046/2127] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:14 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:14.878982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:14.880671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:14.881842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ad32e11-66ef-4f70-ae4b-8e71292d1d8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.229437 Sep 19 12:14:14.882490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1082/2128] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:15.894708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:15.895350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:15.902033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:15.903068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:15.903068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:15.903680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:15.904186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:15.904613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:15.908449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:15.909057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:15.915603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:15.916347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:15.916996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:15.918256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:15.918719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:15.919153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:16.103794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:16.112098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8fc43c06-a6a5-4cf1-91a1-fc751fb30ff7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.221710 Sep 19 12:14:16.112674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1047/2129] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:15 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:16.114586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:16.123205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:16.124681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:16.126294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56cab730-e306-4150-aa56-de0c81440bcb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221754 Sep 19 12:14:16.126852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1083/2130] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:17.135350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:17.136510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:17.142918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:17.143396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:17.143822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:17.144503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:17.144950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:17.145397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:17.152366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:17.153050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:17.160061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:17.160619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:17.161148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:17.161959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:17.162485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:17.162981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:17.343789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:17.350823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:17.352844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9abaf09c-651c-4cc9-8423-1bca36f7624e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.221494 Sep 19 12:14:17.353427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1048/2131] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:17 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:17.359560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:17.361046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:17.362208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62657d4a-3f7c-49bf-b6cd-e926736e9ad0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213924 Sep 19 12:14:17.362752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1084/2132] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:18.376615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:18.377193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:18.384825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:18.385316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:18.385751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:18.386480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:18.386932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:18.387354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:18.388994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:18.390106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:18.396976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:18.397455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:18.397931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:18.398623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:18.399074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:18.399501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:18.585121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:18.585890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:18.595500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a5b54f2-43b8-4780-a213-1ff8bb40d353 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223309 Sep 19 12:14:18.595683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:18.596071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1049/2133] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:18 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:18.596954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:18.598167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b150373-c508-450e-8c5d-c60df7808b80 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213573 Sep 19 12:14:18.598703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1085/2134] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:19.618543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:19.619299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:19.621658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:19.624268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:19.624877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:19.627709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:19.628192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:19.628622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:19.629321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:19.629813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:19.630235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:19.631910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:19.632407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:19.632845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:19.633534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:19.634018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:19.634445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:19.645465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:19.823031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:19.825966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:19.832054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f0f1c03-23a4-421b-be53-9e96b80fd908 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217413 Sep 19 12:14:19.832631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1050/2135] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:19 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:19.834485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:19.835937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:19.837096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05775182-9241-43e9-9532-16d57d96d7be tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216813 Sep 19 12:14:19.837643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1086/2136] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:20.855621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:20.856234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:20.862736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:20.863117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:20.863523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:20.863682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:20.863805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:20.864374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:20.864831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:20.865256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:20.865983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=50 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:20.871297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:20.871780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:20.872209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:20.872890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:20.873343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:20.873784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:21.055905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:21.059134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:21.064224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-945dcfec-5f26-4247-8d27-6337d1269677 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.212443 Sep 19 12:14:21.064953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1051/2137] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:20 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:21.068283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:21.069731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:21.070927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ff4abbb-d08b-46e7-9b88-c6c45b2c4601 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.211675 Sep 19 12:14:21.071455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1087/2138] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:22.087781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:22.088398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:22.095802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:22.096288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:22.096733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:22.097074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:22.097595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:22.097908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:22.098103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:22.098334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:22.104433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:22.104905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:22.105336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:22.106055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:22.106505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:22.106928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:22.293509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:22.298091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:22.302552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-64423097-0d54-45ab-a34a-1470067fbbfb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.218640 Sep 19 12:14:22.303125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1052/2139] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:22 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:22.306632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:22.308069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:22.309215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5027e654-023f-413a-8b4b-d0189140cef2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216517 Sep 19 12:14:22.309897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1088/2140] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:23.325639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:23.326290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:23.333517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:23.334042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:23.334485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:23.335183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:23.335641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:23.335873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:23.336307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:23.336541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:23.343489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:23.344178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:23.344477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:23.345160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:23.345611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:23.346058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:23.528879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:23.532175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:23.537024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a6b39ea-5eec-4723-a957-bcdf43dc8a0f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215172 Sep 19 12:14:23.537658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1053/2141] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:23 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:23.541030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:23.542517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:23.543677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efbc4692-1237-49fe-bac9-38097c99f42f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212076 Sep 19 12:14:23.544217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1089/2142] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:24.561074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:24.561682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:24.568605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:24.568902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:24.569314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:24.569505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:24.569627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:24.570214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:24.570665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:24.571081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:24.576027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:24.576513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:24.576947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:24.577641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:24.578127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:24.579199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:24.760239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:24.767571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:24.769248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cb29e660-369e-4409-8904-4d2aa08fe3f6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211890 Sep 19 12:14:24.769854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1054/2143] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:24 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:24.776348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:24.777796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:24.778935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cdce2186-a2bc-4d04-b411-271cfdd5f500 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214019 Sep 19 12:14:24.779596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1090/2144] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:25.791261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:25.791877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:25.798863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:25.799373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:25.799814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:25.800503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:25.800956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:25.801381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:25.804855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:25.805466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:25.811778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:25.812291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:25.812726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:25.813412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:25.814553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:25.814978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:25.987967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:25.996093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b2e4cbe-ae57-4c68-b75c-a4b9f0a41f6f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.208716 Sep 19 12:14:25.996671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1055/2145] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:25 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:26.001448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:26.011521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:26.013031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:26.014213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3e65625-5094-4794-9db3-552495fafb76 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213374 Sep 19 12:14:26.014771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1091/2146] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:27.019785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:27.020454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:27.028228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:27.029215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:27.029666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:27.030390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:27.030836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:27.031255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:27.042319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:27.042921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:27.049829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:27.050313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:27.050748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:27.051443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:27.051891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:27.052328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:27.244198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:27.247792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:27.253225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c841e01d-8c8c-4a67-9bdb-c190a4d73877 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.237840 Sep 19 12:14:27.253894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1056/2147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:27 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:27.257185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:27.258668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:27.259834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bbdda48-3d33-48da-9c46-12cfb039ce6f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.223463 Sep 19 12:14:27.260386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1092/2148] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:28.276633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:28.277245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:28.283790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:28.284278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:28.284714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:28.285405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:28.285894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:28.286323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:28.288210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:28.288855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:28.290835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:14:28.291000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 (ip 10.222.0.88) !!! Sep 19 12:14:28.302969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:28.303452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:28.303904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:28.304581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:28.305033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:28.305455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:28.480261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:28.484498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:28.489166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92f3a061-1905-4be4-b664-f681066db061 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216553 Sep 19 12:14:28.489742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1057/2149] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:28 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:28.493821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:28.495341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:28.496506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e156539d-c0cc-4393-bd2c-b3202ad9a59d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212295 Sep 19 12:14:28.497052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1093/2150] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:29.512336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:29.512882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:29.519597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:29.520086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:29.520528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:29.521227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:29.521596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:29.522056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:29.522177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:29.522278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:29.528759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:29.529231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:29.529684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:29.530384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:29.530835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:29.531248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:29.714918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:29.717851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:29.724106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f42f9479-0a8e-4fdf-98b6-6d328aca4f2b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215686 Sep 19 12:14:29.724686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1058/2151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:29 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:29.727479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:29.728915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:29.730102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65c0c2bf-371c-42c7-8bae-a2a65a9e7693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212306 Sep 19 12:14:29.730652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1094/2152] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:30.748108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:30.748954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:30.757224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:30.757718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:30.758186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:30.758456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:30.758938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:30.759077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:30.759341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:30.759773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:30.766066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:30.766561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:30.767001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:30.767694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:30.768152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:30.768574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:30.963098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:30.966480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:30.972471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:30.974055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:30.974761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bff2b8a7-1ffb-4318-aaa9-4fabba47649b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.230665 Sep 19 12:14:30.975330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1059/2153] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:30 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:30.975469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3b3ecde-9f71-49cf-a5bb-9fcb96e25e9c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.222290 Sep 19 12:14:30.976042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1095/2154] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:31.998244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:31.998863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:32.000179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:32.001309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:32.005417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:32.005938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:32.006370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:32.007055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:32.007500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:32.007866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:32.007984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:32.008354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:32.008788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:32.009478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:32.009968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:32.010586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:32.201942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:32.205932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:32.210918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6636fe96-4606-484f-8a47-4f7699cfd3d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216442 Sep 19 12:14:32.211489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1060/2155] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:31 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:32.215244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:32.216416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:32.217565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcecf236-bc2d-44c1-be27-0623a3085cc4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221240 Sep 19 12:14:32.218144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1096/2156] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:33.234410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:33.234957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:33.241378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:33.241900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:33.242053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:33.242487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:33.242649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:33.243009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:33.243459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:33.243879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:33.249092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:33.249578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:33.250047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:33.250763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:33.251210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:33.251785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:33.272896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:33.438734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:33.441986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:33.447111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b46bad7-810b-4f0f-b46c-2e6c32f38d04 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216548 Sep 19 12:14:33.447679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1061/2157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:33 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:33.450757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:33.452191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:33.453336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a52f9a52-0a7e-4f49-8b71-bf2a8a33c28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215229 Sep 19 12:14:33.454418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1097/2158] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:34.471352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:34.471961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:34.478443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:34.478922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:34.479293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:34.479696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:34.479897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:34.480021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:34.480463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:34.480886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:34.486889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:34.487375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:34.487806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:34.488492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:34.488943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:34.489365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:34.677059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:34.680477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:34.685380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75a83a7d-a91f-4440-8dae-390e9318d701 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.218354 Sep 19 12:14:34.686247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1062/2159] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:34 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:34.689568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:34.691058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:34.692216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e505416f-ffc0-42a5-ba24-ae76d29eab79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216826 Sep 19 12:14:34.692761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1098/2160] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:35.709128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:35.709651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:35.716699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:35.717191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:35.717308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:35.717720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:35.717882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:35.718339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:35.718794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:35.719222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:35.724867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:35.725349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:35.725798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:35.726490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:35.726941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:35.727364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:35.911563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:35.915471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:35.920355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:35.921820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:35.923622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-363b0a57-c78b-4536-9991-8858e692426b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.210563 Sep 19 12:14:35.924062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47549e23-6216-4a2e-a782-576e4402cf6c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.218841 Sep 19 12:14:35.924194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1099/2161] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:35.924619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1063/2162] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:35 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:36.947089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:36.947700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:36.948494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:36.949136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:36.954304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:36.954787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:36.955220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:36.955907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:36.956019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:36.956361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:36.956497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:36.956781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:36.956893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:36.957565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:36.958165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:36.958589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:37.150350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:37.154596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:37.159118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14701d5b-30c3-43c1-8724-ce6bbb3e108e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215364 Sep 19 12:14:37.159959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1100/2163] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:36 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:37.164246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:37.165689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:37.166885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c910d06-b23a-4b34-952f-1cd571a03d0a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.222250 Sep 19 12:14:37.167581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1064/2164] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:38.184395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:38.185011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:38.191436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:38.191919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:38.192212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:38.192643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:38.192820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:38.193028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:38.193480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:38.193937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:38.199074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:38.199552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:38.199985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:38.200673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:38.201122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:38.201546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:38.385735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:38.393036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:38.395320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:38.396830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:38.398166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f4239ee0-27cc-40cd-b8a3-ec9e0a71a016 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.209780 Sep 19 12:14:38.398750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1065/2165] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:38.401436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39a7f9f3-0b06-4c9d-9af0-cecca30cf5b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.222973 Sep 19 12:14:38.402033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1101/2166] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:38 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:39.425153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:39.425826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:39.429946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:39.430590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:39.432257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:39.432733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:39.433191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:39.433896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:39.434524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:39.434944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:39.437554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:39.438698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:39.439248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:39.439945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:39.440400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:39.440827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:39.626702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:39.630669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:39.635644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:39.637247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:39.638527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e627dcb1-7b36-4b8e-812b-7f0d5ffc1707 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217779 Sep 19 12:14:39.638742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbcd3229-fc74-479d-af9c-715cfaffca2c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.212624 Sep 19 12:14:39.639444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1066/2167] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:39.639586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1102/2168] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:39 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:40.662397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:40.662943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:40.664284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:40.665016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:40.669294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:40.669791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:40.670245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:40.670936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:40.671211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:40.671395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:40.671784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:40.671902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:40.672212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:40.672906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:40.673358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:40.674014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:40.674474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:41.072632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:41.076741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:41.081601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd3cf52a-527c-4691-88eb-3717405b14a7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.423190 Sep 19 12:14:41.082287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1067/2169] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:40 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:41.086115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:41.087621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:41.089088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-33b2f2f1-bede-4c92-b092-9d3cffe8db5c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.428413 Sep 19 12:14:41.089707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1103/2170] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:42.105535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:42.106198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:42.112610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:42.112941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:42.113373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:42.113519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:42.113649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:42.114240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:42.114694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:42.115155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:42.120213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:42.120694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:42.121158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:42.121873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:42.122324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:42.122741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:42.299744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:42.308077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69bf2938-0adc-46c8-86cf-c7b8079da44d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.206230 Sep 19 12:14:42.308455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1068/2171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:42 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:42.310825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:42.319561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:42.321060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:42.322403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ce1c078-de9b-4117-995e-6a44eb9b90de tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213293 Sep 19 12:14:42.322949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1104/2172] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:43.331224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:43.331835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:43.338338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:43.339076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:43.339510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:43.340197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:43.340652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:43.341076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:43.348914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:43.349627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:43.356044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:43.356513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:43.356944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:43.357634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:43.358108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:43.358532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:43.544391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:43.552976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2ccce603-2615-4abb-bb7b-ad45fccc4125 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.225650 Sep 19 12:14:43.554163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1069/2173] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:43 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:43.562215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:43.575473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:43.576957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:43.578480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61ba6fe5-02cf-4a29-8f51-a6de8c53139c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.233922 Sep 19 12:14:43.579227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1105/2174] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:44.577332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:44.577987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:44.584400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:44.584878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:44.585310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:44.586029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:44.586482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:44.586907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:44.607578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:44.609009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:44.618151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:44.619096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:44.619868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:44.621110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:44.621828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:44.622475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:44.782813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:44.790953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f90e44a6-e693-412b-a506-519cd0ac9cd7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217476 Sep 19 12:14:44.791522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1070/2175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:44 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:44.807768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:44.816983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:44.818483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:44.819618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a12b497-2475-439a-a40a-5a8c45431a5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.218013 Sep 19 12:14:44.820159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1106/2176] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:45.814225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:45.814843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:45.823203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:45.823686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:45.824121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:45.824808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:45.825261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:45.825685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:45.845615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:45.846253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:45.852517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:45.853001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:45.853433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:45.854141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:45.854593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:45.855014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:46.024104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:46.027289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:46.032426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-004f9ba4-a4f8-4e30-8487-f53f74b04c25 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.222067 Sep 19 12:14:46.033112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1071/2177] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:45 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:46.035897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:46.037337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:46.038529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40ccf962-4b4d-4d2d-a275-7a442ab4e7ba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.196814 Sep 19 12:14:46.039105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1107/2178] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:47.055645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:47.056260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:47.062694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:47.063175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:47.063613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:47.064065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:47.064471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:47.064680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:47.064800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:47.065158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:47.071667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:47.072150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:47.072584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:47.073304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:47.073755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:47.074206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:47.258650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:47.261538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:47.266922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3acb2b29-55d8-41f2-96a9-5f28fdb781e6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215175 Sep 19 12:14:47.267487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1072/2179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:47 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:47.270084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:47.271533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:47.272693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7123e284-508d-4b38-b214-5528e75f8c9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212484 Sep 19 12:14:47.273435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1108/2180] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:48.290512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:48.291130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:48.296848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:48.297450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:48.297889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:48.298382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:48.298821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:48.299517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:48.299971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:48.300392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:48.303917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:48.304388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:48.304817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:48.305501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:48.305979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:48.306395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:48.491506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:48.494533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:48.500343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-401b2de1-3e2b-4750-940f-d02aa7088b21 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.213685 Sep 19 12:14:48.500914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1073/2181] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:48 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:48.503930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:48.505380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:48.506569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe7e4df9-6d83-4dd9-8496-b6b8945f8912 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213616 Sep 19 12:14:48.507117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1109/2182] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:49.524629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:49.525238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:49.531786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:49.532267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:49.532397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:49.532791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:49.532990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:49.533399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:49.533839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:49.534874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:49.540031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:49.540514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:49.540949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:49.541647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:49.542127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:49.542573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:49.729088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:49.732041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:49.737396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d0b47f5-5690-4386-875b-a9be6f622fd0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216602 Sep 19 12:14:49.738006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1074/2183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:49 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:49.741031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:49.742588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:49.743861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69ef1662-eb29-4d54-ad1a-d5165cd8e28f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215434 Sep 19 12:14:49.744474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1110/2184] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:50.762086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:50.762698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:50.765035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:50.770402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:50.770882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:50.771016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:50.771440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:50.771558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:50.771991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:50.772440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:50.772865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:50.777650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:50.778153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:50.778581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:50.779260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:50.779702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:50.780119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:50.960377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:50.963342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:50.969470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:50.970955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:50.972196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad8b6e95-8d03-4f50-b8cc-34c128777a90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.213503 Sep 19 12:14:50.972627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a61fd706-e71a-4e8d-9da9-72dacee02b14 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.205755 Sep 19 12:14:50.985784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1075/2185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:50 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:50.986397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1111/2186] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:51.997369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:51.998056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:51.999130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:51.999932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:52.004355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=50 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:52.005150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:52.006082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:52.006233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:52.006968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:52.007375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:52.007799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:52.009651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:52.010235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:52.010591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:52.011284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:52.013048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:52.013048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:52.211009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:52.214662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:52.220136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:52.222100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:52.223247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb22e891-f605-497a-8fd7-606a5dd41a2c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.228215 Sep 19 12:14:52.223794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d5e38d09-1673-4584-9c16-98903985888e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.231546 Sep 19 12:14:52.223955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1112/2187] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:14:52.224355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1076/2188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:51 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:53.247260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:53.247899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:53.249170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:53.249799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:53.254871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:53.255352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:53.255807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:53.256486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:53.256621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:53.256931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:53.257106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:53.257349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:53.257544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:53.258275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:53.258729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:53.259157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:53.443112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:53.451338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78604a58-0b4d-46c7-ac5f-47f567635b63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.207850 Sep 19 12:14:53.451909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1113/2189] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:53 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:53.454044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:53.462763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:53.464458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:53.465608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ee2bcdc7-bb20-4191-9113-e4cf71d1f077 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.220305 Sep 19 12:14:53.466192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1077/2190] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:54.474981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:54.475603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:54.482292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:54.482775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:54.483209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:54.483894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:54.484354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:54.484781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:54.488786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:14:54.491078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:54.491979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:54.498285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:54.498760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:54.499188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:54.500013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:54.500310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:54.500722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:54.680340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:54.687015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:54.688768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ceed55ae-a566-43e4-88c4-9c0db48088b7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217839 Sep 19 12:14:54.689349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1114/2191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:54 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:14:54.696133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:54.697561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:54.698736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aed752bb-7bb6-497e-9f50-a3800c8e6bed tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.211679 Sep 19 12:14:54.699295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1078/2192] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:55.712693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:55.713288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:55.720150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:55.720632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:55.721062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:55.722458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:55.722912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:55.723335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:55.725403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:55.726061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:55.732299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:55.732768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:55.733196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:55.733897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:55.734345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:55.734760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:55.925814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:55.929871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:55.934490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9225dd6-8836-48ea-aa45-63e9a8447675 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.225570 Sep 19 12:14:55.935115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1115/2193] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:55 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:55.938517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:55.939943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:55.941578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-55ade2f4-bfa3-4677-b555-8cf1d2d6ac53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.220654 Sep 19 12:14:55.942202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1079/2194] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:56.959262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:56.959861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:56.966628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:56.967114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:56.967482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:56.967884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:56.968115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:56.968238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:56.968670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:56.969095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:56.974720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:56.975262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:56.975701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:56.976398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:56.976853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:56.977282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:57.158898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:57.165708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:57.167081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93a3eff8-4355-4a20-87ca-0e17ce822c62 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.212314 Sep 19 12:14:57.167645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1116/2195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:56 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:57.175030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:57.176586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:57.177791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9bdf2baa-4bb6-4a5c-a283-e4d1c69bb29c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214385 Sep 19 12:14:57.178365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1080/2196] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:58.191803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:58.192414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:58.198851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:58.199429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:58.199871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:58.200577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:58.201029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:58.201451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:58.204845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:58.205463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:58.212130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:58.212616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:58.213054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:58.214039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:58.214498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:58.214927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:58.397964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:58.404196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:58.409671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14bbe0f0-e412-428d-baad-69beba64caba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.222167 Sep 19 12:14:58.412601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1117/2197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:58 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:58.413265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:58.414840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:58.416092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a9080593-994f-46dd-88f9-4e4cc05a1780 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215462 Sep 19 12:14:58.424338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1081/2198] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:14:59.433545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:59.434161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:59.440686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:59.441089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:14:59.441573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:59.441573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:59.441795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:14:59.442298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:59.442744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:59.443278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:59.448111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:59.448586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:59.449217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:59.450164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:14:59.450818 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:14:59.451439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:14:59.635987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:59.645008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa4e3dbf-c663-43cc-9e32-6e2777b32b84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215547 Sep 19 12:14:59.645677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1118/2199] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:14:59 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:14:59.657684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:59.667290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:59.668720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:14:59.669935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9c244d80-7d6f-409c-85d6-08d3f38fa1c0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.232713 Sep 19 12:14:59.670491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1082/2200] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:14:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:00.668283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:00.668908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:00.675870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:00.676349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:00.676786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:00.677470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:00.677957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:00.678378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:00.695894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:00.696506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:00.702844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:00.703319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:00.703763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:00.704454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:00.704909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:00.705338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:00.866403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:00.874526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3bf62db-097c-4af2-b59c-488facde3571 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.210047 Sep 19 12:15:00.875090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1119/2201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:00 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:00.879757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:00.881961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:00.894981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:00.897633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:00.899263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b7d5f96d-de5c-4825-a8f6-27cefb09ba9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.207302 Sep 19 12:15:00.899839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1083/2202] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:01.901908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:01.902463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:01.909416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:01.909923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:01.910351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:01.911023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:01.911463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:01.911876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:01.926259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:01.926873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:01.933219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:01.933706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:01.934177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:01.934874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:01.935331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:01.935769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:02.100906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:02.109206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb322299-5474-4d4f-91a6-ad46ab6a23d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211317 Sep 19 12:15:02.109791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1120/2203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:01 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:02.115379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:02.123958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:02.125475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:02.126657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39ff7b15-38a2-4b7b-a0d7-afbbf714f2d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.204813 Sep 19 12:15:02.127247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1084/2204] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:03.133111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:03.133752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:03.139902 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:03.140384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:03.140834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:03.141510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:03.141999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:03.142425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:03.152447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:03.153082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:03.159208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:03.159683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:03.160116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:03.160797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:03.161249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:03.161663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:03.338339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:03.345238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:03.346912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11e5210a-19ef-47f5-9110-5148efa13cfa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217695 Sep 19 12:15:03.347485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1121/2205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:03 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:03.353914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:03.355524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:03.356683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6431e512-0c4e-4b97-b2fe-74f6eec6ac23 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.208024 Sep 19 12:15:03.357238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1085/2206] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:04.371239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:04.371885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:04.379002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:04.379505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:04.379915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:04.380603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:04.381056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:04.381479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:04.383099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:04.383706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:04.389912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:04.390390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:04.390820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:04.391499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:04.391950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:04.392365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:04.576813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:04.580181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:04.585012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c15f7af0-3476-4dd4-ba59-aa359aebd8bf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217662 Sep 19 12:15:04.585582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1122/2207] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:04 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:04.589264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:04.590718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:04.591896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3eeeb6b6-da5d-470f-aa96-a1f3a3622d9b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213300 Sep 19 12:15:04.592444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1086/2208] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:05.608943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:05.609552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:05.616613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:05.616911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:05.617395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:05.617506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:05.617619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:05.618246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:05.618694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:05.619112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:05.623902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:05.624390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:05.624826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:05.625516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:05.625992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:05.626417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:05.826125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:05.826368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:05.826494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d3a782ac-cb35-4675-a2fa-6a9db2367696 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216237 Sep 19 12:15:05.826494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1123/2209] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:05 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:05.826672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:05.826984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:05.828130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-242deee9-ace7-4501-867d-cb75d3b2a72c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215566 Sep 19 12:15:05.834896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1087/2210] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:06.844344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:06.844955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:06.851562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:06.852051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:06.852491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:06.853193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:06.853654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:06.854101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:06.854446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:06.855202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:06.861795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:06.862276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:06.862716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:06.863419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:06.863873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:06.864297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:07.058887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:07.062878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:07.067117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c686b1dc-55de-4544-9caf-b5dc648e9f7f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.226488 Sep 19 12:15:07.067693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1124/2211] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:06 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:07.071641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:07.073100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:07.074399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3e25b5bb-6271-426f-b31a-6a53af3c7a51 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.223850 Sep 19 12:15:07.074959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1088/2212] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:08.092322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:08.092961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:08.099827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:08.100332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:08.100760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:08.100893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:08.101374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:08.101496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:08.101904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:08.102327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:08.107683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:08.108167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:08.108604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:08.109293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:08.109750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:08.110200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:08.296307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:08.299245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:08.304665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b7b5220-18d7-4d2c-9b7d-146380294344 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216359 Sep 19 12:15:08.305229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1125/2213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:08 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:08.307902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:08.309347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:08.310543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-164db3d3-22fe-4115-8773-eee4824ef634 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214136 Sep 19 12:15:08.311085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1089/2214] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:09.328152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:09.328762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:09.335317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:09.335794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:09.336238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:09.336238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:09.336445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:09.337026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:09.337506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:09.337951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:09.343167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:09.343655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:09.344090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:09.344785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:09.345239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:09.345665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:09.539573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:09.542794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:09.547897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d963e7f-3abf-4f13-8239-faa122c3d074 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223670 Sep 19 12:15:09.548560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1126/2215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:09 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:09.551914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:09.553356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:09.554542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2cd5e700-ad71-4b7f-b32d-638c67765a35 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.222599 Sep 19 12:15:09.555089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1090/2216] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:10.571203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:10.571809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:10.578448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:10.579025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:10.579455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:10.579816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:10.580288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:10.580455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:10.580578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:10.580980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:10.587141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:10.587622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:10.588056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:10.588995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:10.589474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:10.589921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:10.774197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:10.778725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:10.782684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d5f8a71-d69a-40d4-9610-6852f9028cac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215261 Sep 19 12:15:10.783460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1127/2217] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:10 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:10.790738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:10.793432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:10.794720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-125db84c-e615-448b-9209-c42ac60553e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.218927 Sep 19 12:15:10.795381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1091/2218] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:11.809911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:11.810529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:11.817597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:11.818109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:11.818546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:11.819235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:11.819690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:11.820117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:11.821156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:11.821824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:11.828137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:11.828626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:11.829065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:11.829755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:11.830235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:11.830663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:12.018896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:12.025935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:12.028301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f97c4783-e4ac-49c1-88c6-8e0a4d19c4fc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.222160 Sep 19 12:15:12.037837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1128/2219] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:11 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:15:12.043819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:12.045291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:12.046493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d98aebb7-1382-4748-a2e5-f9072d236c74 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.229202 Sep 19 12:15:12.047049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1092/2220] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:12.327121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-431c22ad-02b3-49e4-bd80-01111b22976e req-3ad733bc-d0b7-4d57-897c-c0cf25fd77d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce686f0f-5a79-48d6-8501-d6f8e781ad39", "name": "network-vif-deleted", "tag": "dd4f044e-c20a-4016-921a-f989ecfd24b9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:15:12.339739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-431c22ad-02b3-49e4-bd80-01111b22976e req-3ad733bc-d0b7-4d57-897c-c0cf25fd77d0 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:12.340219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-431c22ad-02b3-49e4-bd80-01111b22976e req-3ad733bc-d0b7-4d57-897c-c0cf25fd77d0 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:12.340721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-431c22ad-02b3-49e4-bd80-01111b22976e req-3ad733bc-d0b7-4d57-897c-c0cf25fd77d0 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:12.354494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-431c22ad-02b3-49e4-bd80-01111b22976e req-3ad733bc-d0b7-4d57-897c-c0cf25fd77d0 service nova] Creating event network-vif-deleted:dd4f044e-c20a-4016-921a-f989ecfd24b9 for instance ce686f0f-5a79-48d6-8501-d6f8e781ad39 on hv-cinder-85829 Sep 19 12:15:12.360143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-431c22ad-02b3-49e4-bd80-01111b22976e req-3ad733bc-d0b7-4d57-897c-c0cf25fd77d0 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036462 Sep 19 12:15:12.360738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1129/2221] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:15:13.050926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:13.051545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:13.058056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:13.058555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:13.058994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:13.059691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:13.060150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:13.060578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:13.073208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:13.074023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:13.082286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:13.082844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:13.083486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:13.084178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:13.084629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:13.085048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:13.272199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:13.276532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:13.283869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e1c5e45-a254-4da3-8452-7a20deef15a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.236889 Sep 19 12:15:13.286883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:13.288609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:13.289905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05e7bc31-ca30-4c13-8d33-9124db2b39b7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221066 Sep 19 12:15:13.293834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1093/2222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:13 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:13.299456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1130/2223] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:14.307738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:14.308351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:14.314718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:14.315207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:14.316272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:14.316969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:14.317425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:14.317882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:14.318420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:14.319025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:14.325372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:14.325889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:14.326321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:14.327002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:14.327450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:14.327865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:14.348950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:14.506631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:14.515463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b2ee063-64a9-4252-a6ac-a5823f81c601 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211457 Sep 19 12:15:14.516213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1094/2224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:14 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:14.531669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:14.541302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:14.542953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:14.544159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1cc509b-ffab-4a0d-a097-19ed86215078 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.230457 Sep 19 12:15:14.544711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1131/2225] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:15.539113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:15.539729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:15.546066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:15.546552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:15.546991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:15.547680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:15.548136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:15.548562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:15.570998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:15.571526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:15.577703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:15.578292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:15.578718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:15.579428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:15.579873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:15.580285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:15.746617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:15.751395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:15.755774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-702241e8-1d29-4d0e-8bcb-0fd1c18efdf1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.220375 Sep 19 12:15:15.756547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1095/2226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:15 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:15.760051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:15.761498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:15.762673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8f0d11e-06ca-4a4e-9b16-2336706e7bba tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.195542 Sep 19 12:15:15.763317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1132/2227] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:16.779686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:16.780303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:16.786735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:16.787220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:16.787655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:16.788346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:16.788464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:16.788868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:16.789067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:16.789211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:16.795802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:16.796303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:16.796749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:16.797426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:16.797898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:16.798312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:16.988535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:16.996685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-348c71af-7ccc-4a13-9cbb-23fbb8aa865f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.220846 Sep 19 12:15:16.997256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1096/2228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:16 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:16.999688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:17.008335 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:17.009865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:17.011129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ac80de7-5259-461d-9363-ff2f25362f79 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.226580 Sep 19 12:15:17.011798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1133/2229] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:18.019806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:18.020435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:18.026744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:18.027225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:18.027658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:18.028338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:18.028789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:18.029210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:18.036357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:18.037049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:18.043583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:18.044070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:18.044511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:18.045206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:18.045656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:18.046110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:18.429456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:18.437734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e58a5f8b-f195-4100-8da6-98a735349f64 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.421682 Sep 19 12:15:18.438165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1097/2230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:18 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:18.440104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:18.448671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:18.450132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:18.451282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a13158c1-f196-4902-b0fa-02d2d1f181b6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.418841 Sep 19 12:15:18.451826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1134/2231] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:19.460971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:19.461564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:19.468165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:19.468640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:19.469071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:19.469745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:19.470217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:19.470637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:19.477356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:19.478067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:19.484654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:19.485229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:19.485737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:19.486458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:19.486913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:19.487895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:19.662868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:19.671334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7bd9b82d-1fbb-43c9-a479-986744d8fa9b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214120 Sep 19 12:15:19.672368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1098/2232] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:19 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:19.674562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:19.695285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:19.696718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:19.697918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe2c4c8d-02dc-45a9-933e-767fd62bd649 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.224682 Sep 19 12:15:19.698473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1135/2233] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:20.695593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:20.696230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:20.702728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:20.703216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:20.703656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:20.704358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:20.704812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:20.705258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:20.725286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:20.726547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:20.735703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:20.736492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:20.736930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:20.738443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:20.738895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:20.739374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:20.921411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:20.924599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:20.930571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a13a53b-edd1-4ab4-9515-c2eeba01f1f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.238858 Sep 19 12:15:20.931216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1099/2234] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:20 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:20.933586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:20.935044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:20.936191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52c66b02-5f4c-4413-88ee-898280019dc0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216451 Sep 19 12:15:20.936727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1136/2235] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:21.953169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:21.953709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:21.956035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:21.960411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:21.961033 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:21.961204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:21.961690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:21.962151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:21.962841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:21.963290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:21.963974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:21.967674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:21.968146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:21.968577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:21.969257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:21.969699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:21.970153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:21.978870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:22.156433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:22.163742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:22.165479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1d0a8ca5-5ae8-4abc-9aa4-cadb7b7143d7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216068 Sep 19 12:15:22.166015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1100/2236] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:21 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:22.172567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:22.174248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:22.175966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6334a008-4ca2-46cf-b36e-b910b48447af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.219403 Sep 19 12:15:22.176507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1137/2237] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:23.196752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:23.197397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:23.200716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:23.201318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:23.204045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:23.204532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:23.204678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:23.204972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:23.205860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:23.207072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:23.207532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:23.209614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:23.210115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:23.210544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:23.211223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:23.211664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:23.212080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:23.398422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:23.402078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:23.407098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e92c6ffb-3a18-4b16-bc54-455174a26469 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214157 Sep 19 12:15:23.407731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1101/2238] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:23 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:23.410975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:23.412425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:23.413576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fdc5ec2-f183-4e6c-aeeb-a38ba91e790a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216603 Sep 19 12:15:23.414158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1138/2239] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:24.430515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:24.431070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:24.437516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:24.438030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:24.438448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:24.438730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:24.439161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:24.439343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:24.439548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:24.439961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:24.445966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:24.446448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:24.446882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:24.447570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:24.448021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:24.448435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:24.633512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:24.637189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:24.642443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:24.644542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:24.645712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2aa19024-fe63-4152-9e2c-0d73c4eceb07 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.210888 Sep 19 12:15:24.645988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3cc7875-a61d-4800-9e7f-6487924af10d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.219342 Sep 19 12:15:24.646306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1139/2240] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:24.646543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1102/2241] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:24 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:25.668984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:25.669555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:25.671787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:25.672404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:25.675788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:25.676280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:25.676719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:25.677414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:25.677895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:25.678320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:25.678756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:25.679239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:25.679676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:25.680540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:25.681012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:25.681432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:25.869846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:25.872795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:25.878793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5dc50e15-59b5-4497-af8c-84c4bf4acc9a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.213977 Sep 19 12:15:25.879358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1140/2242] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:25 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:25.881984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:25.883411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:25.884559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-736a2cf3-aa19-4d25-bae2-90dcc5f861f6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217087 Sep 19 12:15:25.885095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1103/2243] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:26.903292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:26.903864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:26.910518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:26.911409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:26.912141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:26.912983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:26.913437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:26.913580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:26.914061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:26.914216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:26.920855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:26.921333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:26.921798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:26.922506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:26.922962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:26.923389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:27.138220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:27.145542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:27.148221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:27.150622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:27.152513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-95a31a86-b2b7-4e1a-9f52-045f332ea674 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.243317 Sep 19 12:15:27.153266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1104/2244] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:27.160288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7dd6e35-9cc6-4554-a659-70e63dfa48df tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.261266 Sep 19 12:15:27.160865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1141/2245] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:26 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:28.178890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:28.179676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:28.183608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:28.184346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:28.185536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:28.186130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:28.186774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:28.187486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:28.187944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:28.188374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:28.191047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:28.191523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:28.191949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:28.192634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:28.193072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:28.193486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:28.379704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:28.383533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:28.388825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:28.390339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:28.391495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-26dc3dad-39b6-4ae5-9c52-704c04c9734d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217155 Sep 19 12:15:28.391616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74c7259a-af94-4dfa-bbe6-501c2cb8392b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211674 Sep 19 12:15:28.392056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1105/2247] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:28.392228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1142/2247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:28 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:15:29.415175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:29.415769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:29.416442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:29.417050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:29.421584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:29.422097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:29.422526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:29.423204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:29.423358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:29.423649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:29.423841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:29.424066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:29.425909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:29.426628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:29.427664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:29.428151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:29.619307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:29.623428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:29.627568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27b7c555-d6cf-43f5-a755-39262ad93e33 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217138 Sep 19 12:15:29.628142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1143/2248] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:29 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:29.632144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:29.633592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:29.634785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c86cf15-769a-444e-974c-76d7ccfd248e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.222258 Sep 19 12:15:29.635337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1106/2249] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:30.650936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:30.651543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:30.658145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:30.658667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:30.659107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:30.659828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:30.659952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:30.660355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:30.660469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:30.660700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:30.666602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:30.667081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:30.667507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:30.668181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:30.669229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:30.669652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:30.853118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:30.857062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:30.861354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9cd295d8-99a6-4d0b-9a25-6dec0bfefe05 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214523 Sep 19 12:15:30.862444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1144/2250] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:30 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:30.866364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:30.867786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:30.868925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ecf3c461-3c2a-44a2-bec0-2a7f48e5614a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212915 Sep 19 12:15:30.869461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1107/2251] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:31.885908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:31.886543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:31.894266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:31.894753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:31.895185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:31.895512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:31.895952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:31.896121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:31.896311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:31.896964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:31.902687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:31.903175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:31.903635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:31.904329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:31.904782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:31.905235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:32.094153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:32.098155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:32.102753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08878a3e-b0c5-4cd7-be66-0215ae03ca84 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.220722 Sep 19 12:15:32.103414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1145/2252] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:31 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:32.106926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:32.108389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:32.109542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29b886f0-0d7d-450a-97d6-6568623ae0a7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.218571 Sep 19 12:15:32.110116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1108/2253] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:33.126550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:33.127170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:33.134359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:33.134846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:33.135285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:33.135881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:33.136327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:33.136438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:33.136554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:33.136826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:33.142879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:33.143343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:33.143775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:33.144457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:33.145102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:33.145522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:33.329401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:33.337832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:33.338046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7bb5ea2-d1be-4764-8a5b-afa71f2d5c90 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215862 Sep 19 12:15:33.339047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1146/2254] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:33 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:33.347238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:33.348673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:33.349853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-515afd10-dae7-4fb7-af00-3aea9aad9cfa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217827 Sep 19 12:15:33.362404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1109/2255] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:34.362134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:34.362748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:34.369045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:34.369523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:34.369994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:34.370693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:34.371148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:34.371573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:34.375831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:34.376445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:34.383404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:34.383893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:34.384332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:34.385028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:34.385484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:34.385936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:34.560851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:34.569726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b4dfad3-af62-4295-8c16-64e26613fa70 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211596 Sep 19 12:15:34.570323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1147/2256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:34 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:34.582083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:34.591020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:34.592501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:34.593661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f0dcc190-dd1c-4bfd-b68d-19da816f6ad8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.222079 Sep 19 12:15:34.594244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1110/2257] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:35.592473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:35.593091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:35.599997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:35.600480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:35.600914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:35.601604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:35.602081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:35.602505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:35.606586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:35.620297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:35.620995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:35.628018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:35.628494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:35.628922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:35.629607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:35.630087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:35.630505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:35.789951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:35.798050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd1e680a-1395-40db-8d81-dfc75526b512 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.209578 Sep 19 12:15:35.798622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1148/2258] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:35 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:35.810888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:35.819372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:35.820813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:35.822007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-062546bd-b352-4977-969f-61e1d96368e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.205554 Sep 19 12:15:35.822561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1111/2259] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:36.822836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:36.823453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:36.829326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:36.829836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:36.830272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:36.830958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:36.831411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:36.831837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:36.847766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:36.848379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:36.854647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:36.855131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:36.855629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:36.856351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:36.856807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:36.857232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:37.020558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:37.028616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92787ed5-63d9-4d0a-a81e-28a65858668c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.209854 Sep 19 12:15:37.029177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1149/2260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:36 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:37.036338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:37.045090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:37.046536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:37.047678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fed09bf5-c705-4326-b194-c4c6b2aef6dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.203939 Sep 19 12:15:37.048221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1112/2261] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:38.053022 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:38.053616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:38.060040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:38.060518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:38.060950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:38.061629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:38.062109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:38.062561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:38.073834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:38.074576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:38.080853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:38.081335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:38.081798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:38.082495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:38.082942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:38.083367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:38.256640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:38.263763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:38.264741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-711276a4-2777-4356-96f6-ef87d8f50119 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216422 Sep 19 12:15:38.265314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1150/2262] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:38 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:38.272951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:38.274430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:38.275616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-eeaef786-2146-4c00-907d-8d49e4a785f3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.205746 Sep 19 12:15:38.276156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1113/2263] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:39.289002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:39.289598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:39.295874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:39.296346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:39.296768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:39.297442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:39.297916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:39.298329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:39.301314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:39.301967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:39.308286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:39.308759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:39.309196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:39.309933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:39.310392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:39.310819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:39.501165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:39.505135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:39.509954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4abb2ec7-9b82-46d2-995c-fad84bbc2947 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.225353 Sep 19 12:15:39.510555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1151/2264] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:39 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:39.513753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:39.515291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:39.516551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1768be66-0d0c-4f75-b24f-49ad007fdbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.219142 Sep 19 12:15:39.517167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1114/2265] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:40.534293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:40.534992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:40.542040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:40.542211 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:40.542630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:40.542782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:40.542931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:40.543625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:40.544078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:40.544502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:40.548787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:40.549272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:40.549712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:40.550436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:40.550888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:40.551317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:40.735905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:40.739814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:40.744566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e248c81f-dc00-4a5c-98b7-40b4ae22c294 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214184 Sep 19 12:15:40.745223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1152/2266] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:40 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:40.750502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:40.751953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:40.753113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-417f603a-4e46-43cb-bd13-332e6220911c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214777 Sep 19 12:15:40.753658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1115/2267] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:41.768431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:41.769040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:41.775534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:41.776016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:41.776447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:41.777132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:41.777583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:41.777892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:41.778342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:41.778509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:41.784778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:41.786110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:41.786554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:41.787257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:41.787712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:41.788142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:41.985207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:41.988124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:41.994693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:41.996101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2df0623d-4afb-4d63-80a4-7799d97c4ba9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.231594 Sep 19 12:15:41.996248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:41.996659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1153/2268] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:41 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:41.997375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-586f0bc8-5305-4c1f-b14a-2100b8e2c52d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.223289 Sep 19 12:15:41.997897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1116/2269] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:43.019219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:43.019966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:43.024747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:43.025497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:43.026460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:43.026945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:43.027590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:43.028296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:43.028758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:43.029183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:43.031915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:43.032400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:43.032837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:43.033528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:43.034007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:43.034430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:43.038944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:43.220236 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:43.223702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:43.228987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-914bb049-4720-46f1-a3cf-466ada287989 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.213603 Sep 19 12:15:43.229793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1154/2270] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:43 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:43.232347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:43.233807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:43.234971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-383b8691-3b50-4046-8b1d-4eac402bb4cb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214070 Sep 19 12:15:43.235522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1117/2271] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:44.252590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:44.253150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:44.259396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:44.259874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:44.260267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:44.260691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:44.260886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:44.260999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:44.261414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:44.261863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:44.266766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:44.267248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:44.267681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:44.268376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:44.268837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:44.269754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:44.455186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:44.458576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:44.464280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1a30554-26b2-454e-b3b1-199c1c841551 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215705 Sep 19 12:15:44.464849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1155/2272] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:44 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:44.467384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:44.468837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:44.470017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dbb625c1-37f0-4777-b2b1-45ab03358057 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214215 Sep 19 12:15:44.470565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1118/2273] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:45.487725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:45.488929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:45.495326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:45.495774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:45.496186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:45.496282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:45.496369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:45.496894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:45.497343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:45.497786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:45.502488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:45.502965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:45.503456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:45.504199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:45.504648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:45.505068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:45.692578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:45.695686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:45.701499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1942de2-545c-45a5-869e-8cc2aa6322ae tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217500 Sep 19 12:15:45.702100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1156/2274] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:45 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:45.704482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:45.705994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:45.707757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1c71557d-93e1-4a36-a652-3162d3f7492b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215891 Sep 19 12:15:45.708307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1119/2275] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:46.724739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:46.725286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:46.731754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:46.732236 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:46.732670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:46.733368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:46.733846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:46.734102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:46.734531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:46.734710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:46.743807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:46.744301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:46.744735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:46.745441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:46.745939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:46.746371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:46.932398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:46.936485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:46.940714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e87f30d-2f90-4f4d-a128-b303b6375c1b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.219894 Sep 19 12:15:46.941330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1157/2276] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:46 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:46.945432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:46.946928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:46.948079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d34b7739-bcc6-4877-ba7b-f03ef53a8ed9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217970 Sep 19 12:15:46.948631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1120/2277] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:47.963913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:47.964506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:47.970899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:47.971382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:47.971817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:47.972505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:47.972892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:47.973297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:47.973412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:47.973513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:47.980578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:47.981064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:47.981525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:47.982245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:47.982701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:47.983127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:48.170267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:48.179912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1530d13-40a2-4089-95d5-46ea5c17e3ab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.219815 Sep 19 12:15:48.180815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1158/2278] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:47 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:48.187620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:48.204227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:48.205666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:48.207109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3df4c018-7672-4b2d-93bd-e6fc7ee1cd42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.238084 Sep 19 12:15:48.207781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1121/2279] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:49.212202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:49.212753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:49.219293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:49.219773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:49.220214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:49.220896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:49.221346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:49.221789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:49.234466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:49.235163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:49.241619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:49.242198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:49.242696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:49.243466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:49.243994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:49.244480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:49.413331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:49.422059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88811536-403b-4b7e-82e1-7934fd93783d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.213663 Sep 19 12:15:49.422632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1159/2280] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:49 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:49.433924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:49.438587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:49.442298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:49.443643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fbabee28-b15e-4967-bf15-85f056cbcb42 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215082 Sep 19 12:15:49.444568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1122/2281] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:50.460655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:50.461270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:50.468045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:50.468533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:50.468847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:50.469288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:50.469549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:50.469666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:50.470113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:50.470538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:50.476237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:50.476712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:50.477139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:50.477837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:50.478285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:50.478702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:50.678040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:50.682088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:50.686611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba6c6c89-1ada-44d3-8628-a665ae4b4b06 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.229830 Sep 19 12:15:50.687173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1160/2282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:50 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:50.691001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:50.692557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:50.693822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9752e9d-da40-408f-913b-ef3650c37d6b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.228969 Sep 19 12:15:50.694483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1123/2283] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:51.710461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:51.711011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:51.717792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:51.718285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:51.718755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:51.719391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:51.719828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:51.719936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:51.720046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:51.720436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:51.726934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:51.727419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:51.727861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:51.728549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:51.729005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:51.729431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:51.911259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:51.914344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:51.919649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91dbb423-2988-427a-8493-988dc6ed0830 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.213652 Sep 19 12:15:51.920222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1161/2284] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:51 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:51.923020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:51.924557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:51.925738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-902afd96-2872-4478-854c-b4b42d088196 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.210115 Sep 19 12:15:51.926364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1124/2285] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:52.943006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:52.943541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:52.950006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:52.950494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:52.950639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:52.951027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:52.951121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:52.951613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:52.952067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:52.952491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:52.953476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:52.958823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:52.959310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:52.959748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:52.960446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:52.960903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:52.961330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:53.147178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:53.149228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:53.156643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:53.158183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:53.158395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fd1453a-d613-4438-b2b0-8307abdaf8c7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.219327 Sep 19 12:15:53.158973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1162/2286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:52 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:53.159872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4934f644-717a-4729-86db-5c7c6a057a1a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212707 Sep 19 12:15:53.160518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1125/2287] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:54.183398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:54.184008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:54.186380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=50 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:54.186812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:54.187428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:54.192946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:54.193432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:54.193897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:54.194432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:54.194592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:54.194918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:54.195068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:54.195358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:54.195486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:54.196061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:54.196515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:54.196941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:54.389728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:54.393014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:54.398916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:54.400289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:54.401499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7552aedd-80a7-4eb4-8ab4-8508bc13143c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.218494 Sep 19 12:15:54.401631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a427e17d-292b-4222-afc5-048f81212eb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223242 Sep 19 12:15:54.402095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1126/2288] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:54.402258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1163/2289] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:54 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:55.426193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:55.426806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:55.427891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:55.428498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:55.432720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:55.433196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:55.433626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:55.434342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:55.434791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:55.434922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:55.435210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:55.435325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:55.435699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:55.436379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:55.436825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:55.437242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:55.626114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:55.629625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:55.636084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:55.636294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:15:55.637854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:55.639124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47b4f69c-93e5-495d-90c9-e87fa1308782 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215541 Sep 19 12:15:55.639554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60d3ac69-097e-4cb5-944b-312a8d092dc7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.218916 Sep 19 12:15:55.640153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1127/2290] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:55.640310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1164/2291] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:55 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:56.662014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:56.662677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:56.665584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:56.666227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:56.670082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:56.670578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:56.671025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:56.671723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:56.672177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:56.672590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:56.672719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:56.673072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:56.673505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:56.674349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:56.674866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:56.675297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:57.071480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:57.079681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6fd733b-d8bb-4dff-843f-192304ffdfa2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.421912 Sep 19 12:15:57.080251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1165/2292] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:56 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:57.082390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:57.091504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:57.092937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:57.094122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6eef391-f894-46b2-b537-ca068daf86a6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.433534 Sep 19 12:15:57.094678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1128/2293] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:15:58.102739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:58.103348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:58.109680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:58.110196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:58.110623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:58.111301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:58.111774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:58.112202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:58.119574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:58.120186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:58.126139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:58.126629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:58.127070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:58.127766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:58.128727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:58.129155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:58.306988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:58.313477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:58.315162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a96b6fc-7cb5-4a2a-8766-88a0bfbf072b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216247 Sep 19 12:15:58.316406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1166/2294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:58 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:58.322731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:58.324169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:58.325326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4edf395e-f54f-412c-93a3-7dc6f4e75256 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.209801 Sep 19 12:15:58.325910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1129/2295] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:15:59.338943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:59.339549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:59.345898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:59.346385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:59.347524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:59.348359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:59.348809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:59.349232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:59.351189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:15:59.352137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:15:59.358396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:59.358882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:59.359318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:59.360023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:15:59.360477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:15:59.360906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:15:59.549938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:59.553052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:59.558528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b026e6f7-7287-4691-82af-a63f6e1e051c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223711 Sep 19 12:15:59.559339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1167/2296] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:15:59 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:15:59.562026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:59.563486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:15:59.564720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf8e9165-48ca-4622-92de-bff89d5020e4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217875 Sep 19 12:15:59.565858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1130/2297] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:15:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:00.582105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:00.582755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:00.589291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:00.589780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:00.590204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:00.590972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:00.591414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:00.591805 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:00.592275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:00.592412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:00.599853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:00.600339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:00.600772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:00.601473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:00.602013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:00.602426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:00.786508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:00.793828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:00.794616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6514c62-2fd2-4786-9540-c59d340a276c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216412 Sep 19 12:16:00.795200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1168/2298] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:00 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:00.802686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:00.804133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:00.805287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-678e4eae-2bad-40bd-9d50-933bd1319aee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.217750 Sep 19 12:16:00.805856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1131/2299] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:01.817578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:01.818235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:01.824558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:01.825040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:01.825467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:01.826178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:01.826626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:01.827043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:01.830620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:01.831268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:01.837578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:01.838105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:01.838803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:01.839523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:01.839978 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:01.840404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:02.020288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:02.024274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:02.028623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-781b41f1-7970-49cc-9bed-5f6d956d639e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214999 Sep 19 12:16:02.029194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1169/2300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:01 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:02.032846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:02.034867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:02.036016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99732310-3759-4af0-a986-b3cf606aff8d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.209373 Sep 19 12:16:02.036589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1132/2301] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:03.052264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:03.052875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:03.059308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:03.059791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:03.060225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:03.060911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:03.061363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:03.061803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:03.062731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:03.063400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:03.067070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:16:03.067277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:16:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 (ip 10.222.0.88) !!! Sep 19 12:16:03.072227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:03.072706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:03.073135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:03.073844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:03.074293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:03.074708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:03.273927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:03.281436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:03.282467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-717c5d4d-dc80-43fa-8682-f0b6c8e77770 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.234511 Sep 19 12:16:03.283047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1170/2302] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:03 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:03.284961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:03.292798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:03.294271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:03.295437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6457ad96-4104-4e00-96ea-aa204067a33c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.236938 Sep 19 12:16:03.295985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1133/2303] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:04.306377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:04.307738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:04.314342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:04.314727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:04.315114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:04.316614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:04.317060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:04.317493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:04.322950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:04.324315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:04.330639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:04.331772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:04.332205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:04.332893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:04.333334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:04.333982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:04.512679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:04.520816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ea9fe3f-cfb2-473e-ad49-42a16cb2501c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.218340 Sep 19 12:16:04.521383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1171/2304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:04 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:04.523910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:04.532413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:04.533870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:04.535031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d507a761-5196-44f9-8492-685631734ff2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216480 Sep 19 12:16:04.535591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1134/2305] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:05.543801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:05.544411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:05.551119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:05.551599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:05.552032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:05.552769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:05.553218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:05.553635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:05.560235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:05.560834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:05.567613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:05.568087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:05.568514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:05.569195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:05.569638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:05.570090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:05.744307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:05.752361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5f0a99b-5d30-4795-bbfa-87915037f258 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.212451 Sep 19 12:16:05.753638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1172/2306] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:05 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:05.760784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:05.770137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:05.771578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:05.772734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e2af6891-a911-49e9-acae-6f10b1c76e15 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216303 Sep 19 12:16:05.773292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1135/2307] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:06.775774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:06.776375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:06.782342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:06.782823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:06.783259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:06.784585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:06.785110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:06.785532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:06.797988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:06.798603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:06.804893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:06.805378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:06.805847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:06.806538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:06.806992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:06.807415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:06.974598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:06.982967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-567d2574-8ef0-4a0a-9314-874ebea7c321 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211149 Sep 19 12:16:06.983556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1173/2308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:06 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:06.990162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:06.998747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:07.000178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:07.001367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bdf0d82c-da25-4a6d-97c1-fb44bac77f0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.207294 Sep 19 12:16:07.001947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1136/2309] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:08.006014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:08.006618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:08.012916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:08.013389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:08.013847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:08.014521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:08.014966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:08.015380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:08.026602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:08.027221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:08.033457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:08.034465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:08.034907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:08.035590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:08.036048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:08.036467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:08.201919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:08.213646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f921cda7-7622-4872-93d4-d91f6c3524ff tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.211119 Sep 19 12:16:08.214259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1174/2310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:08 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:08.227327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:08.235921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:08.237363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:08.238537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-75302967-7435-4211-a2ae-fdfd0a987f4d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.215869 Sep 19 12:16:08.239088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1137/2311] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:09.237955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:09.238556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:09.245065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:09.245536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:09.245993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:09.246673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:09.247115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:09.247535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:09.263258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:09.263866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:09.270407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:09.270912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:09.271344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:09.272030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:09.272482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:09.272903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:09.442577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:09.449528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:09.451241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-034a10a6-a284-417d-950f-97ae1603b1bd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217575 Sep 19 12:16:09.451891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1175/2312] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:09 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:09.458302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:09.459736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:09.460889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-62697df1-1f94-4daf-a65d-f80afbd44326 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.201488 Sep 19 12:16:09.461429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1138/2313] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:10.475199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:10.475807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:10.477711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:16:10.477878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:16:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e (ip 10.222.0.88) !!! Sep 19 12:16:10.484517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:10.484998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:10.485425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:10.486147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:10.486596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:10.487041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:10.489118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:10.492507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:10.499110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:10.499645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:10.500074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:10.500765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:10.501210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:10.501827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:10.688881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:10.692389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:10.697476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9d3908a-8802-4b9f-9146-eb1fe31205e2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.226698 Sep 19 12:16:10.698076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1176/2314] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:10 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:10.701088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:10.702629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:10.703793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4c645428-9d54-4555-8e42-1e77cbf55ab0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.220988 Sep 19 12:16:10.704337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1139/2315] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:11.722208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:11.722847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:11.729782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:11.730206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:11.730620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:11.730713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:11.730822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:11.731522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:11.731976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:11.732397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:11.735810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:16:11.735945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:16:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 (ip 10.222.0.88) !!! Sep 19 12:16:11.739166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:11.740045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:11.740682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:11.741972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:11.742437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:11.742869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:11.932794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:11.936930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:11.940950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d13aad5a-0a1c-4853-bb16-0b4f4684fc38 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223102 Sep 19 12:16:11.941524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1177/2316] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:11 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:11.945510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:11.946963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:11.948110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51402316-6f5e-473a-8acf-3cd722298830 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221881 Sep 19 12:16:11.948649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1140/2317] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:12.964690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:12.965276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:12.971809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:12.972285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:12.972716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:12.973393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:12.973866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:12.974256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:12.974714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:12.974874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:12.980969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:12.981457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:12.981928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:12.982623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:12.983077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:12.983499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:13.177506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:13.181923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:13.185906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fce77d0e-ffbd-4a78-99ee-98f82f17801b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.225273 Sep 19 12:16:13.186483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1178/2318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:12 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:16:13.191581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:13.193015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:13.194465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe923d2b-75b5-498a-ae1b-1f97047a8701 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.223985 Sep 19 12:16:13.195013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1141/2319] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:14.209961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:14.210568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:14.217158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:14.217633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:14.218097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:14.218776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:14.219226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:14.219649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:14.224883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:14.225621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:14.232055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:14.232528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:14.232961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:14.233650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:14.234134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:14.234556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:14.416849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:14.420727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:14.425726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cd28eed-03c1-4f5a-8923-6b99fd81ac2f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.220070 Sep 19 12:16:14.426329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1179/2320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:14 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:14.430166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:14.431590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:14.432729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8affce5f-1fe0-4ba6-8827-34d6d1c20353 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212321 Sep 19 12:16:14.433328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1142/2321] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:15.449438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:15.450069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:15.456523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:15.457016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:15.457446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:15.458145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:15.458577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:15.459001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:15.459001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:15.459203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:15.465887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:15.466373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:15.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:15.467499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:15.467953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:15.468379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:15.652359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:15.655300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:15.661363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4285b961-a230-4651-9a84-995b169c2614 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.215706 Sep 19 12:16:15.661957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1180/2322] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:15 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:15.664461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:15.665939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:15.667099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-048278aa-27b1-4b44-9b59-28b952400f69 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.212405 Sep 19 12:16:15.667643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1143/2323] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:16.685189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:16.685796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:16.693284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:16.693453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:16.693910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:16.694122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:16.694254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:16.694882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:16.695326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:16.695742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:16.703155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:16.703647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:16.704085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:16.704810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:16.705289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:16.705744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:16.713822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:16.894745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:16.903367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee6395d2-acf0-48dc-a5a3-970a3d24bbba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.221940 Sep 19 12:16:16.903776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1181/2324] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:16 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:16.907202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:16.916743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:16.918237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:16.919409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d494b45a-b885-4145-b568-ec11b15784a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.230658 Sep 19 12:16:16.919943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1144/2325] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:17.930407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:17.931007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:17.937295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:17.937798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:17.938224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:17.938905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:17.939353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:17.939916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:17.945938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:17.948253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:17.957336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:17.957846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:17.958286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:17.958988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:17.959440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:17.959868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:18.143059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:18.146941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:18.151674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7d3ec4d-d61b-4ceb-990d-e3837de7ec63 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.225314 Sep 19 12:16:18.152251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1182/2326] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:17 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:18.155666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:18.157108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:18.158301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f9b9443-3ed7-4664-86e9-f2b37929edd2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216417 Sep 19 12:16:18.158846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1145/2327] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:19.174582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:19.175191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:19.181536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:19.182060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:19.182496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:19.183185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:19.183636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:19.184064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:19.184469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:19.185298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:19.193200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:19.193687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:19.194157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:19.194890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:19.195345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:19.195776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:19.378354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:19.381585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:19.387126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-309dbac8-7e1d-4a33-9b39-b05b8a3ea662 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216338 Sep 19 12:16:19.388159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1183/2328] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:19 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:19.391349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:19.393364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:19.394595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58fd732f-b151-4b12-802c-bd6a2bfa47bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214390 Sep 19 12:16:19.395145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1146/2329] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:20.412555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:20.413927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:20.419713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:20.420330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:20.421046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:20.421575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:20.422155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:20.422875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:20.423321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:20.423737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:20.426676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:20.427158 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:20.427589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:20.428272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:20.428719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:20.429142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:20.623544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:20.625433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:20.631950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f04b82b9-4c94-46ea-8c50-56e00b4aa76e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223783 Sep 19 12:16:20.632720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1184/2330] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:20 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:20.635979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:20.637439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:20.640105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97dbf905-daa0-468f-b359-52683eda720c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.224234 Sep 19 12:16:20.640651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1147/2331] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:21.655795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:21.656404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:21.663288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:21.663771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:21.664206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:21.664891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:21.665341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:21.665728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:21.666168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:21.666367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:21.672621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:21.673099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:21.673533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:21.674903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:21.675358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:21.675783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:21.855929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:21.860047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:21.864533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:21.866001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:21.867161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1050b4a8-923d-40a5-8aa0-0f35c3e1dd09 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.205326 Sep 19 12:16:21.867720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1148/2332] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:21.868294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4bffc80c-4d61-4620-8bd1-4482a888768f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.216362 Sep 19 12:16:21.868894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1185/2333] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:21 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:22.891959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:22.892574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:22.893043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:22.893658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:22.898962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:22.899444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:22.899879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:22.900008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:22.900434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:22.900567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:22.900870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:22.901002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:22.901418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:22.901539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:22.902032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:22.902460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:23.093514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:23.096953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:23.102910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:23.104339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:23.105105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7cba5577-5ac9-43c3-954c-ea3ea8ca2a27 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217026 Sep 19 12:16:23.105474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45537be7-8418-40cf-bae9-20e338ad17e6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.216375 Sep 19 12:16:23.105827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1149/2334] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:22 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:23.106417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1186/2335] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:24.129892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:24.130845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:24.131460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:24.132135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:24.134136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:24.137574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:24.138086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:24.138512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:24.138993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:24.139200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:24.139506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:24.139743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:24.139931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:24.140115 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:24.140619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:24.141068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:24.141511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:24.155827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:24.550340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:24.553368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:24.559308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4908ef93-b7a1-4f5a-aefd-7a2f9923dd1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.434144 Sep 19 12:16:24.559885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1150/2336] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:24 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:24.562444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:24.563965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:24.565683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-595af7ce-e7a4-413f-a82f-93d27bd82ebd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.438817 Sep 19 12:16:24.566327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1187/2337] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:25.583990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:25.584764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:25.591631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:25.592061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:25.592495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:25.592672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:25.592786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:25.593391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:25.593876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:25.594325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:25.595161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=50 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:25.601485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:25.602055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:25.602500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:25.603352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:25.603932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:25.604356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:25.795358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:25.798922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:25.803695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d8152c76-8774-4992-a761-c6ca66bc10af tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.224336 Sep 19 12:16:25.804382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1151/2338] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:25 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:25.807657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:25.809083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:25.810275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40ca6ffc-4d35-4712-88f9-0bf442601851 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.222459 Sep 19 12:16:25.810821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1188/2339] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:26.828285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:26.828903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:26.835559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:26.835751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:26.836225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:26.836416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:26.836792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:26.837901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:26.838619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:26.839042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:26.842810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:26.843300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:26.843734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:26.844430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:26.844881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:26.845308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:27.032804 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:27.037628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:27.042402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5b6b2841-fceb-4489-9bfc-5ffae07646c9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.218701 Sep 19 12:16:27.042982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1152/2340] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:26 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:27.050564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:27.051997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:27.053221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86bf8ef3-e56e-4297-9278-0a2c6097bc26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221616 Sep 19 12:16:27.053780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1189/2341] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:28.066143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:28.066746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:28.072961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:28.073440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:28.073902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:28.074593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:28.075047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:28.075469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:28.078715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:28.079442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:28.085706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:28.086217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:28.086649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:28.087341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:28.087789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:28.088211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:28.270914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:28.282597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6ec43a9d-71bf-4b98-b5bf-64f5776b0ed5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.220232 Sep 19 12:16:28.284163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1153/2342] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:28 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:28.290255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:28.299296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:28.300743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:28.301952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f01dd848-ddf5-48ab-bbc5-cc8f6477eea5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.226948 Sep 19 12:16:28.302516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1190/2343] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:29.307829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:29.308669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:29.316168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:29.316643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:29.317073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:29.317755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:29.318222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:29.318638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:29.326958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:29.327567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:29.335125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:29.335620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:29.336055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:29.336752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:29.337205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:29.337630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:29.515396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:29.524536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-156074a5-e982-438f-8ce4-3f85b0a77817 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.220284 Sep 19 12:16:29.525834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1154/2344] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:29 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:29.536964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:29.546062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:29.547506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:29.549248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b45e6564-0e2e-4cfd-a07c-a7d8ba99ad2d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.225574 Sep 19 12:16:29.550012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1191/2345] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:30.550033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:30.550712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:30.557176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:30.557637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:30.558996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:30.558996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:30.559283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:30.560207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:30.593188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:30.594327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:30.606161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:30.608358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:30.609410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:30.611851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:30.612906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:30.613933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:30.763547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:30.777875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-32765d64-6f30-49f1-b391-c1b8392800d8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.231817 Sep 19 12:16:30.790230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1155/2346] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:30 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:30.795417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:30.806364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:30.807789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:30.808951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac85a5bc-7996-4a6a-96ca-37fa217c6970 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221619 Sep 19 12:16:30.809510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1192/2347] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:31.816889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:31.817514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:31.823901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:31.824378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:31.824811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:31.825500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:31.825986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:31.826412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:31.838972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:31.839658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:31.848177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:31.848671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:31.849112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:31.849917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:31.850279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:31.850701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:32.032021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:32.036242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:32.040518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-781a6bd6-a1e3-4bdd-b3e7-725699ce28de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.228032 Sep 19 12:16:32.041091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1156/2348] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:31 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:32.045406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:32.046893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:32.048056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-474ffb59-0434-40b2-89f0-51a105d03003 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.214087 Sep 19 12:16:32.049089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1193/2349] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:33.064731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:33.065325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:33.071920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:33.072449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:33.072878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:33.073564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:33.074030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:33.074446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:33.075099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:33.075717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:33.082443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:33.082927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:33.083363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:33.084054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:33.084509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:33.084955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:33.297324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:33.303053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:33.311651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9d363919-157d-418a-882b-8b79fb226b09 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.250798 Sep 19 12:16:33.312394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1157/2350] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:33 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:33.312910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:33.314514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:33.316058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf35e3da-8404-4092-b9dd-49ed590839b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.244889 Sep 19 12:16:33.316630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1194/2351] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:34.341168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:34.342170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:34.342331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:34.342941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:34.350124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:34.350342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:34.350737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:34.351441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:34.351897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:34.352323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:34.352485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:34.354104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:34.354540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:34.355235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:34.355684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:34.357209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:34.553262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:34.557574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:34.561799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f48196e-4408-442c-8e62-190d49f4ab8d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.225134 Sep 19 12:16:34.562389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1158/2352] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:34 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:34.567574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:34.569020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:34.570217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b874642-8976-4d25-8b45-d38d6fcea14c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.232155 Sep 19 12:16:34.570762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1195/2353] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:35.585987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:35.586601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:35.593259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:35.593741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:35.594208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:35.594904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:35.595401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:35.595824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:35.596628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:35.597232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:35.603840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:35.604321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:35.604755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:35.605450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:35.605952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:35.606377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:35.795394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:35.799254 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:35.804248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-daff095c-97dc-44aa-980d-9c3df52b3f51 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.222132 Sep 19 12:16:35.804822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1159/2354] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:35 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:35.808102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:35.809565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:35.810748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7003855e-d958-4966-9e5e-5b7c0a17f5da tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.218057 Sep 19 12:16:35.811299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1196/2355] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:36.827168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:36.827785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:36.834593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:36.835083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:36.835520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:36.836221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:36.836333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:36.836764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:36.836878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:36.837087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:36.843316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:36.843801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:36.844242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:36.844941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:36.845965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:36.846396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:37.036362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:37.040660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:37.044824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-987eed47-dd3e-4851-a185-7565dd64adfe tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.221519 Sep 19 12:16:37.045389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1160/2356] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:36 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:37.049930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:37.051445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:37.052631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7efc71d2-cd0e-4633-87e4-c0410d44db3b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.220305 Sep 19 12:16:37.053200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1197/2357] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:38.067452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:38.068061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:38.074616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:38.075106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:38.075543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:38.076238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:38.076690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:38.077189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:38.078547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:38.079149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:38.086044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:38.086529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:38.086956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:38.087641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:38.088085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:38.088756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:38.093023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:38.278123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:38.280655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:38.286726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d5dee3bc-46cd-4313-a73d-36f159d42480 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.223170 Sep 19 12:16:38.287306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1161/2358] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:38 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:38.290185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:38.291631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:38.292831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4cb68e2-fbca-475c-834a-2ef1db65de90 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.218197 Sep 19 12:16:38.293325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1198/2359] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:39.309878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:39.310523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:39.317588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:39.318104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:39.318541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:39.319243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:39.319657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:39.320131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:39.320131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:39.320416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:39.337504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:39.337504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:39.337504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:39.337504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:39.338116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:39.338116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:39.522468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:39.526624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:39.530777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-73585b56-2d95-4ace-8d3c-b898c57b50f4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.224662 Sep 19 12:16:39.531352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1162/2360] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:39 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:39.535912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:39.537362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:39.538553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ad204d1-2dce-4262-9a74-0384e0d5dfc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.224318 Sep 19 12:16:39.539107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1199/2361] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:40.555134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:40.555742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:40.562308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:40.562793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:40.563224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:40.563918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:40.564118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:40.564579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:40.564703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:40.564820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:40.571246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:40.571736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:40.572173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:40.572869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:40.573324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:40.573754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:40.757164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:40.760532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:40.766086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:40.767635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:40.768816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd166a43-a917-4e8a-a31e-32fca1ee5fda tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.208863 Sep 19 12:16:40.769145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-607b6bd3-3400-4474-874b-89c8c2192d52 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217817 Sep 19 12:16:40.769544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1200/2362] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:40.769973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1163/2363] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:40 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:41.792299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:41.792912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:41.795030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:41.795643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:41.799379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:41.799860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:41.800295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:41.800991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:41.801443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:41.801909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:41.802275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:41.802769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:41.803241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:41.803890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:41.804334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:41.804751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:41.997215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:42.001692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:42.006154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4d472b5-c8df-4b2a-ab59-c94bf10f8330 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217660 Sep 19 12:16:42.006727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1201/2364] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:41 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:42.010351 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:42.011820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:42.012984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59eac291-760a-4a0e-ae34-5395cf67a9b3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.221852 Sep 19 12:16:42.013530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1164/2365] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:43.030566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:43.031183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:43.037651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:43.038169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:43.038612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:43.039097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:43.039552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:43.039702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:43.039825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:43.040194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:43.046221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:43.046700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:43.047135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:43.047824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:43.048302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:43.048729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:43.246394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:43.250671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:43.255884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c605eaaa-35c8-48d2-b182-803f852af8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.229182 Sep 19 12:16:43.256473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1202/2366] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:43 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:43.260895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:43.262459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:43.263613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e195b423-424a-450f-b219-432a016dfc18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.228394 Sep 19 12:16:43.264165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1165/2367] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:44.279356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:44.279969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:44.286429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:44.286912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:44.287346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:44.288035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:44.288488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:44.288919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:44.289887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:44.290499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:44.296776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:44.297262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:44.297698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:44.298422 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:44.298874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:44.299297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:44.485029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:44.488076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:44.493461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9bf2f027-2030-4e68-a847-33fba46eb3e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.217972 Sep 19 12:16:44.494088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1203/2368] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:44 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:44.496772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:44.498261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:44.499432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-212ec362-a333-444b-98eb-c62029e96295 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213705 Sep 19 12:16:44.499982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1166/2369] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:45.519281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:45.520319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:45.525343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:45.525976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:45.526888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:45.527378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:45.527817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:45.528522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:45.528976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:45.529405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:45.532510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:45.532982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:45.534059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:45.534770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:45.535224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:45.535645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:45.539736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:45.737261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:45.741325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:45.747775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:45.749263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:45.749622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-502ddc57-d077-405f-b2aa-000d7fbbc5ce tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.234807 Sep 19 12:16:45.750240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1204/2370] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:45 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:45.750476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9a1a3c4f-1ff2-4962-85d6-8c107fe14fae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.229249 Sep 19 12:16:45.751026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1167/2371] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:46.776713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:46.777440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:46.787149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:46.787369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:46.788074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:46.789274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:46.789731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:46.790798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:46.791429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:46.791859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:46.794194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:46.794679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:46.795105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:46.795791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:46.796435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:46.796856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:46.998900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:47.001986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:47.009257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:47.010914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:47.011303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f3b9a0f-44f6-4917-a583-aecd5c556cbb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.229414 Sep 19 12:16:47.011890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1168/2372] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:46 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:47.012420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a297f18-6e8b-4f93-a47a-111a0e3e76d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.239561 Sep 19 12:16:47.024710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1205/2373] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:48.038359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:48.038902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:48.040354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:48.041339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:48.046378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:48.046905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:48.047490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:48.048000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:48.048203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:48.048485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:48.048660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:48.049000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:48.049729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:48.050263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:48.050715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:48.051138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:48.249045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:48.253241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:48.258361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:48.259796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:48.260984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f4e249c-0f21-4bfd-94f8-46c405877d89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.225529 Sep 19 12:16:48.261564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18922e7e-23f3-48ed-9709-24a7608ca047 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.227087 Sep 19 12:16:48.261739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1206/2374] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:48.262156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1169/2375] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:48 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:49.286115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:49.286712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:49.288062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:49.289447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:49.293248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:49.293738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:49.294210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:49.294917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:49.295038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:49.295363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:49.295493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:49.295783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:49.295892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:49.296584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:49.297032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:49.297459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:49.524235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:49.530699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:49.532682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cfe780a0-4f02-4b47-9d0a-a985a405bb7c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.248386 Sep 19 12:16:49.533688 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1170/2376] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:49 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:16:49.540058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:49.541501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:49.542679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-129f57d1-9932-43b9-aa20-d561209b2538 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.260622 Sep 19 12:16:49.543225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1207/2377] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:50.556471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:50.557067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:50.563596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:50.564084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:50.565020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:50.565712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:50.566195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:50.566622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:50.568782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:50.569427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:50.575586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:50.576074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:50.576508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:50.577197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:50.577649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:50.578093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:50.791948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:50.795075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:50.804548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:50.806113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:50.807043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d612ff3f-dd61-41a1-a021-0fe3a88e83c8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.254439 Sep 19 12:16:50.807270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-085bc957-d0a8-48aa-9393-41d60bca63d9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.242796 Sep 19 12:16:50.807997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1171/2378] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:50 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:16:50.808123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1208/2379] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:51.830482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:51.831696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:51.834636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:51.835244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:51.838136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:51.838881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:51.839313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:51.840004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:51.840453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:51.840875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:51.842074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:51.842560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:51.842998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:51.843690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:51.844142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:51.846041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:52.032357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:52.035241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:52.040856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-42585a9c-6731-41cd-81f3-97213dadc901 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.214106 Sep 19 12:16:52.041630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1172/2380] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:51 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:52.048063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:52.049683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:52.050880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb171649-c2c7-4666-b9f6-7a3b8ca4d163 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.220786 Sep 19 12:16:52.051463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1209/2381] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:53.077839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:53.078745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:53.079016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:53.080119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:53.087008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:53.087396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:53.087785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:53.087927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:53.088269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:53.088829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:53.088948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:53.089258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:53.089655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:53.089810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:53.090127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:53.090542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:53.304819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:53.313576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:53.313785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:53.315054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:53.316233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92602bc2-6867-4221-9233-14e351a0228e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.242328 Sep 19 12:16:53.316788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1173/2382] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:53.322624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8cfdd429-7dd7-49f0-a0bb-e5062c01e67a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.247984 Sep 19 12:16:53.323241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1210/2383] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:53 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:16:54.343020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:54.343580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:54.345756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=48 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:54.348687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:54.349295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:54.351440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:54.351933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:54.352370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:54.353071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:54.353519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:54.353976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:54.355685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:54.356176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:54.356613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:54.357301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:54.357756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:54.358208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:54.501881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:54.511328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c39a4dc1-bb94-4d29-b925-8509d1875002 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.167797 Sep 19 12:16:54.511907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1211/2384] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:54 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:16:54.857561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:54.869778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:54.871372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:54.872361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6b5c92a-9666-4521-8252-e58dd2f4e29f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.533796 Sep 19 12:16:54.872920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1174/2385] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:55.536004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:55.536602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:55.543337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:55.543820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:55.544257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:55.544946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:55.545399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:55.545848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:55.684478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:55.694887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d95b6e20-406d-482c-8ad5-ed5193421880 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.162843 Sep 19 12:16:55.695509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1212/2386] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:55 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:55.900520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:55.901113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:55.908132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:55.909325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:55.909831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:55.910656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:55.911160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:55.911648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:56.046279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:56.054865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:56.056308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:56.057459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fe306057-d67f-4a23-a9dd-e1fbc950c624 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.160818 Sep 19 12:16:56.058207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1175/2387] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:56.719362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:56.719967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:56.722322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=50 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:56.727473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:56.727950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:56.728383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:56.729071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:56.729521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:56.730003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:56.862986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:56.871135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-028bb403-0b53-4cd2-b788-3c64bbdcdbc3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.155710 Sep 19 12:16:56.871703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1213/2388] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:56 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:57.083356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:57.084036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:57.090718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:57.091199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:57.091656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:57.092346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:57.092790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:57.093204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:57.223287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:57.231844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:57.233308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:57.234522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bcd737bd-6cb2-4c87-9f45-5dce1670e787 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155270 Sep 19 12:16:57.235080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1176/2389] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:16:57.894013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:57.894602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:57.901044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:57.901522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:57.901989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:57.902672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:57.903122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:57.903543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:58.035088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:58.038504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:16:58.044246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebc560e5-ddc1-4979-9c87-87973e1c89cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.154152 Sep 19 12:16:58.044942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1214/2390] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:57 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:58.260104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:58.260714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:58.267034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:58.267525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:58.267960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:58.268646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:58.269094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:58.269516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:58.398262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:58.407035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:58.408481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:58.409661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fd791c18-89d2-4a25-83b5-93c9ab134d32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.153505 Sep 19 12:16:58.410240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1177/2391] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:16:59.067994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:59.068587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:59.075119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:59.075593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:59.076062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:59.076743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:59.077189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:59.077602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:59.218883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:59.227355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8c9ca73-47fb-43a3-990b-78e07bedfd0e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.163291 Sep 19 12:16:59.227945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1215/2392] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:16:59 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:16:59.436288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:16:59.436855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:16:59.444599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:59.445480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:59.445864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:59.446788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:16:59.447288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:16:59.447713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:16:59.578236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:59.587393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:59.589089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:16:59.590275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58e02518-b8cf-4390-bbd0-966bb5db811d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.158229 Sep 19 12:16:59.590849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1178/2393] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:16:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:17:00.251191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:00.251812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:00.258295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:00.258775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:00.259579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:00.259884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:00.260331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:00.260751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:00.388912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:00.397618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28b5a0e8-f04b-41b6-b6e2-db4885b6b322 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.150306 Sep 19 12:17:00.398322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1216/2394] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:00 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:00.615771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:00.616379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:00.622701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:00.623176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:00.623659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:00.624295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:00.624743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:00.625197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:00.756436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:00.766025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:00.767793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:00.769715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60804def-7dc8-4554-9fc5-39fa6d54a8d3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.157863 Sep 19 12:17:00.770436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1179/2395] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:01.422806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:01.424454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:01.430406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:01.430878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:01.431303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:01.431985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:01.432427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:01.432842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:01.561280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:01.570948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a160d9e-37f5-46df-b236-62c49ec832a9 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.151949 Sep 19 12:17:01.573439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1217/2396] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:01 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:01.795809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:01.795809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:01.802735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:01.803214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:01.803645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:01.804335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:01.804782 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:01.805202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:01.934931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:01.943397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:01.944803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:01.945986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4ae427a5-6848-469f-ad75-e2edc03ca8b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.154659 Sep 19 12:17:01.946519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1180/2397] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:02.597120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:02.597755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:02.603803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:02.604282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:02.604715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:02.605397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:02.605871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:02.606293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:02.739877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:02.748095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86a055ee-9fb1-4f8d-bd80-b8ed4fe579ee tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.155382 Sep 19 12:17:02.748659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1218/2398] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:02 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:02.973291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:02.973875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:02.980839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:02.981329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:02.981788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:02.982494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:02.982947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:02.983369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:03.116663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:03.125383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:03.126874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:03.128058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6c261119-7237-4641-bde2-fbff7cf09709 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159240 Sep 19 12:17:03.133000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1181/2399] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:03.772465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:03.773100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:03.781244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:03.781784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:03.782262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:03.782977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:03.783602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:03.784132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:03.933577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:03.942962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42c1ad63-5481-43c3-b6ac-da2436de8bb8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.174897 Sep 19 12:17:03.943535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1219/2400] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:03 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:17:04.155891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:04.156637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:04.164068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:04.164557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:04.164983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:04.165679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:04.166159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:04.166578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:04.329153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:04.339039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:04.340495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:04.341690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49ed42df-c158-4461-98ed-14fbfe1c6871 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.189962 Sep 19 12:17:04.342295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1182/2401] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:04.977406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:04.978101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:04.986838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:04.987341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:04.987778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:04.988488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:04.989054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:04.989580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:05.143086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:05.156669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ac8a0bb-5aca-4012-b933-dabc1282806d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.187762 Sep 19 12:17:05.168686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1220/2402] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:04 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:05.368169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:05.368747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:05.375259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:05.375735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:05.376164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:05.376859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:05.377888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:05.378310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:05.521927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:05.524290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:05.534183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:05.535602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:05.536821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-214d6525-8cc6-4036-9069-b00718551134 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.172673 Sep 19 12:17:05.537386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1183/2403] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:05 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:06.182734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:06.183333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:06.189908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:06.190395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:06.190835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:06.191531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:06.191985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:06.192415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:06.332456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:06.341962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4641cffc-a327-4862-9c90-0a5206ebdd31 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.162883 Sep 19 12:17:06.342486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1221/2404] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:06 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:06.564153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:06.564778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:06.571227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:06.571741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:06.572210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:06.574562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:06.575108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:06.575557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:06.708614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:06.717461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:06.718943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:06.720091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1833e9b5-2559-4dec-b9c8-cb775088ed99 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159907 Sep 19 12:17:06.720660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1184/2405] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:07.371238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:07.371846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:07.378829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:07.379332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:07.379762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:07.380485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:07.380948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:07.381364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:07.509088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:07.517213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70bd80d9-2400-475d-920f-70d52c4bfeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.153884 Sep 19 12:17:07.518140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1222/2406] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:07 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:07.746530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:07.747149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:07.753829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:07.754342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:07.754780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:07.755479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:07.755934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:07.756365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:07.889202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:07.898457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:07.899895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:07.901054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2342da9f-4997-4929-89bd-faf3996d7ab3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.158449 Sep 19 12:17:07.901613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1185/2407] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:17:08.541663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:08.542508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:08.549573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:08.550084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:08.550614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:08.551351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:08.551820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:08.552235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:08.682041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:08.690929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61db29d3-ef86-4827-9460-aaca4d8202e5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.153085 Sep 19 12:17:08.691505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1223/2408] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:08 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:17:08.927062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:08.927680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:08.934245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:08.934723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:08.935152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:08.935832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:08.936276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:08.936691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:09.075871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:09.085439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:09.086940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:09.088205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9dc45149-e5f2-4bd8-a1b7-be23f0fd5665 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.165504 Sep 19 12:17:09.089048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1186/2409] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:09.714571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:09.715177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:09.722609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:09.723200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:09.723637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:09.724399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:09.724790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:09.725209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:09.863285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:09.875516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46badc46-5b68-4f76-a9b8-51a02780046e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.164845 Sep 19 12:17:09.876737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1224/2410] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:09 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:10.113940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:10.114721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:10.121298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:10.121811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:10.122256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:10.122963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:10.123419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:10.123846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:10.279742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:10.290309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:10.291734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:10.292899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-113d110d-bfb6-4183-8a24-114dc5245e04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.183439 Sep 19 12:17:10.293465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1187/2411] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:10.904622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:10.905539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:10.912221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:10.912706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:10.913145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:10.914115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:10.914438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:10.914887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:11.054749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:11.063229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d67e8b3f-d362-41df-bcee-080640a0f21c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.162534 Sep 19 12:17:11.063816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1225/2412] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:10 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:11.320194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:11.320833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:11.327629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:11.328119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:11.328549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:11.329259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:11.329713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:11.330887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:11.470227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:11.478948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:11.480597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:11.481827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b38ef6a9-f856-42f8-a047-a0d5f6bd6c5f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.165593 Sep 19 12:17:11.482385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1188/2413] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:12.087237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:12.087850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:12.094835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.095329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.096252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.096957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.097397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.097836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.239122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:12.247993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c9a1bff-7291-4c4a-8fbb-2565d49c117c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.164333 Sep 19 12:17:12.248901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1226/2414] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:12 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:12.508816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:12.509378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:12.515918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.516401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.516832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.518063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:12.518510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:12.518926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:12.660609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:12.670078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:12.671700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:12.672918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-727d02e4-a091-41ad-a12f-9d569d9b6a59 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.168225 Sep 19 12:17:12.673480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1189/2415] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:13.271706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:13.272295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:13.278920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:13.279398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:13.279825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:13.280535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:13.280975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:13.281390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:13.431509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:13.440579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66f98a59-1dae-40e4-915d-d016235129cc tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.172689 Sep 19 12:17:13.441151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1227/2416] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:13 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:13.699735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:13.700418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:13.707867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:13.708360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:13.708807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:13.710094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:13.710582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:13.711316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:13.846400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:13.855443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:13.856924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:13.858161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b11dafa-cdad-4bed-b449-ebebf029b486 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.162491 Sep 19 12:17:13.858725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1190/2417] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:14.465282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:14.465930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:14.474006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:14.474498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:14.474933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:14.475633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:14.476086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:14.476510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:14.625038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:14.634979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6647018-e039-41d7-af17-081e0e87d1cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.173902 Sep 19 12:17:14.635565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1228/2418] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:14 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:17:14.884418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:14.885125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:14.892871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:14.893372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:14.893994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:14.894843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:14.895398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:14.895817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:15.055175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:15.066466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:15.067985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:15.069212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9f3c7e7f-1423-49ad-83bc-96567d586e8c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.188725 Sep 19 12:17:15.069802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1191/2419] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:15.660222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:15.660847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:15.667440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:15.667922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:15.668354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:15.669049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:15.669503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:15.669961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:15.815118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:15.823969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea97dc83-9090-4263-a7de-687cbebfb7f5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.168253 Sep 19 12:17:15.824571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1229/2420] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:15 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:16.098261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:16.098903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:16.105366 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:16.105876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:16.106313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:16.107006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:16.107539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:16.107880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:16.253811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:16.264149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:16.265862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:16.267183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-26649e7f-3a72-4418-ad1b-0fa92d13c9b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.172808 Sep 19 12:17:16.267769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1192/2421] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:17:16.848828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:16.849418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:16.855877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:16.856352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:16.856776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:16.857479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:16.857957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:16.858372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:16.986650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:16.994913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f03dba99-3434-4edb-9680-9f8f0364bcb1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.150514 Sep 19 12:17:16.995406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1230/2422] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:16 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:17.294251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:17.294863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:17.301508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:17.302123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:17.302628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:17.303397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:17.303944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:17.304438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:17.441111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:17.449716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:17.451181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:17.452339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dceba18e-a57d-4c87-a2c1-69a2ea8e1a30 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.162070 Sep 19 12:17:17.452940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1193/2423] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:18.018821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:18.019463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:18.027527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:18.028015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:18.028452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:18.029151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:18.029864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:18.030679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:18.051887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:18.184472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:18.194446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee298380-2c24-4eb8-9404-03ee1c4cc8de tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.180081 Sep 19 12:17:18.195082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1231/2424] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:18 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:17:18.479046 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:18.479634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:18.486644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:18.487126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:18.487557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:18.488238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:18.488680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:18.489098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:18.621664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:18.631739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:18.633179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:18.634367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-23ac2f0a-1ca3-4809-a28f-58d5117460e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159234 Sep 19 12:17:18.634923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1194/2425] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:19.218868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:19.219467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:19.226646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:19.227129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:19.227566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:19.228258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:19.228711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:19.229135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:19.369603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:19.379357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95291b1e-1b93-4b49-8ef3-f5fa66dc3b8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.164271 Sep 19 12:17:19.382395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1232/2426] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:19 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:19.661070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:19.661634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:19.668249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:19.668731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:19.669170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:19.669875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:19.670328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:19.670749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:19.813353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:19.824065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:19.825558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:19.826907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4326ca47-74db-422a-9b7b-4bcd806924d6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.170675 Sep 19 12:17:19.827664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1195/2427] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:20.407216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:20.407783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:20.414633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:20.415111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:20.415539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:20.416227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:20.416673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:20.417091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:20.580435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:20.590779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b43c7d8f-f743-4b38-a367-7dbbf6fa65d3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.187412 Sep 19 12:17:20.591620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1233/2428] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:20 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:20.854900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:20.855732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:20.863037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:20.863572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:20.864089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:20.864872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:20.865396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:20.865909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:21.021737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:21.030357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:21.031792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:21.032987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec70d7cd-208a-4600-8d61-d40b88bb2e5a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.182616 Sep 19 12:17:21.033545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1196/2429] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:21.617883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:21.618505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:21.625019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:21.625498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:21.625972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:21.627769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:21.627769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:21.628137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:21.764223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:21.772503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5300198-3010-4a3f-9d97-fc58eb218f86 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.158530 Sep 19 12:17:21.773072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1234/2430] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:21 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:22.058745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:22.059344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:22.065831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:22.066319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:22.066758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:22.067447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:22.067900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:22.068325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:22.210522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:22.219747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:22.221838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:22.223005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b59b46e-dc0a-45d6-aa6a-1ce875d5ea18 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.168166 Sep 19 12:17:22.223562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1197/2431] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:22.801663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:22.802315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:22.808635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:22.809116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:22.809546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:22.810274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:22.810726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:22.811146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:23.091124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:23.099420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b11a594-bdde-43c1-aa64-f721372e392f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.302806 Sep 19 12:17:23.099980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1235/2432] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:22 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:23.248878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:23.249437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:23.255870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:23.256343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:23.256795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:23.257473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:23.258025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:23.258445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:23.399987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:23.409327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:23.410786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:23.411969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0bbb19a6-501f-42a6-87e5-1f82b6d4a150 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.167050 Sep 19 12:17:23.412543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1198/2433] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:24.124592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:24.125375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:24.133655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:24.134300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:24.134901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:24.135735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:24.136321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:24.136882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:24.282288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:24.290735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44795431-cf45-4b5a-b342-62fbc549c937 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.170871 Sep 19 12:17:24.291290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1236/2434] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:24 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:24.438331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:24.438959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:24.441921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:24.447381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:24.447865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:24.448304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:24.449228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:24.449687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:24.450145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:24.590558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:24.599303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:24.600773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:24.602039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d0df47a4-11f2-4798-9b19-f4ab84bc494c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.167526 Sep 19 12:17:24.602612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1199/2435] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:25.315021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:25.315655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:25.322730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:25.323313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:25.323931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:25.324678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:25.325408 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:25.326061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:25.551210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:25.560353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3153ca46-aa09-4991-9bea-95bbddd96b6e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.249959 Sep 19 12:17:25.560904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1237/2436] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:25 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:25.628134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:25.628668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:25.635133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:25.635610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:25.636037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:25.636721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:25.637168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:25.637585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:25.653141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:25.775561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:25.789437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:25.792091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:25.794099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8ddd177-1e92-4032-bf6d-6b796a3048fe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.169987 Sep 19 12:17:25.795034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1200/2437] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:26.585691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:26.586316 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:26.593124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:26.593608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:26.594066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:26.594761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:26.595208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:26.595667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:26.743485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:26.752162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c31e08c1-ee1e-46ce-ad28-81dcaeaa8f8f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.170312 Sep 19 12:17:26.753266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1238/2438] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:26 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:26.828886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:26.829502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:26.836109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:26.837254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:26.837697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:26.838685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:26.839135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:26.839558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:26.984841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:26.994235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:26.995662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:26.996836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ede4bdce-dd6a-4be3-8091-145fdf17eac2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.172189 Sep 19 12:17:26.997648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1201/2439] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:17:27.776241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:27.776936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:27.779302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:27.784781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:27.785266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:27.785698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:27.786420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:27.786868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:27.787286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:27.928834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:27.937449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ec3f818-bf30-47ab-a672-b2621ce0b573 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.165149 Sep 19 12:17:27.938269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1239/2440] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:27 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:28.023196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:28.023830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:28.030493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:28.030914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:28.031347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:28.032040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:28.032490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:28.032911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:28.165109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:28.176273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:28.178116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:28.179456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3559f540-41fa-4aa5-a580-d35cf06688a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.160162 Sep 19 12:17:28.180093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1202/2441] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:28.963778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:28.964438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:28.970835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:28.971950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:28.972382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:28.973075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:28.973523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:28.973985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:29.111944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:29.120561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62d2c067-d131-49ff-a2fd-a1455e12e853 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.161402 Sep 19 12:17:29.121133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1240/2442] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:28 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:29.211354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:29.212004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:29.218950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:29.219342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:29.219775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:29.220479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:29.220931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:29.221398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:29.374763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:29.384923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:29.386381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:29.387553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6b37e63b-0356-4466-b43e-e73d1555e7b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.180176 Sep 19 12:17:29.388432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1203/2443] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:17:30.144292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:30.144893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:30.151457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:30.151929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:30.152360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:30.153046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:30.153501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:30.153951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:30.287494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:30.296320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95ad5a29-28e2-4fc4-a699-14e8d778c1a4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156055 Sep 19 12:17:30.296894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1241/2444] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:30 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:30.415510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:30.416547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:30.424515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:30.425081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:30.425523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:30.426322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:30.426771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:30.427221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:30.564958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:30.577042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:30.578742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:30.580141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ffbb5e4-3d08-4df3-acc5-b317bdedcff7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.168914 Sep 19 12:17:30.581430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1204/2445] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:31.320364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:31.321015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:31.329066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:31.329548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:31.330000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:31.330687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:31.331130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:31.331544 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:31.480443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:31.497722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbb9183e-3729-4f8a-86be-2ab5fc34608b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.181263 Sep 19 12:17:31.498537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1242/2446] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:31 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:17:31.613891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:31.614581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:31.624493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:31.624984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:31.625425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:31.626172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:31.626624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:31.627044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:31.773739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:31.782696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:31.784728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:31.785927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-63cd418b-02b0-4b3b-bd53-3e1c9795a053 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.176609 Sep 19 12:17:31.786486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1205/2447] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:32.525729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:32.526406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:32.534383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:32.535007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:32.536118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:32.538306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:32.540036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:32.541563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:32.682116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:32.690702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39ff18f8-d365-48a6-950e-ad91c5a379e4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.168808 Sep 19 12:17:32.691280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1243/2448] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:32 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:32.810758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:32.811570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:32.818685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:32.819171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:32.819618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:32.820317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:32.820768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:32.821192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:32.958973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:32.968006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:32.969433 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:32.970630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc19bc95-8cfb-4d5f-9a61-d6d330d79916 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.163802 Sep 19 12:17:32.971190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1206/2449] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:33.716410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:33.717162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:33.725341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:33.725844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:33.726367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:33.727182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:33.727748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:33.728246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:33.884702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:33.895640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-314e41cb-e0e4-4bbb-beb4-dc8d22e17ba0 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.184333 Sep 19 12:17:33.896214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1244/2450] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:33 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:33.997988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:33.998692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:34.006229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:34.006809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:34.007319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:34.008154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:34.008654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:34.009180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:34.158456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:34.168113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:34.169729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:34.170914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2981fb86-7a3f-4224-92d7-3905632f399d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.177774 Sep 19 12:17:34.171469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1207/2451] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:34.930303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:34.930879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:34.937224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:34.937700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:34.938163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:34.938851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:34.939294 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:34.939726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:35.078871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:35.087422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93452690-8905-4da8-ae85-9d0b633c21e1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.161642 Sep 19 12:17:35.087997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1245/2452] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:34 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:35.197281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:35.197932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:35.204344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:35.204835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:35.205272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:35.206005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:35.206460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:35.206885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:35.356756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:35.366687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:35.368116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:35.369277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-86883c25-e59f-452f-b101-681e29685a27 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.176810 Sep 19 12:17:35.369851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1208/2453] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:36.110274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:36.110903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:36.117420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:36.117946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:36.118385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:36.119082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:36.119538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:36.119965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:36.256370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:36.265109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f2405ee-b340-4f13-af79-bdc2c64db172 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.158626 Sep 19 12:17:36.265683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1246/2454] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:36 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:36.405826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:36.406837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:36.416561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:36.417333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:36.418036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:36.419159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:36.419908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:36.420619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:36.564252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:36.573623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:36.575091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:36.576262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0054aefd-4c72-4704-b439-bdf6ac18a8a1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.176573 Sep 19 12:17:36.576851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1209/2455] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:37.289862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:37.290765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:37.297113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:37.297598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:37.298062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:37.298760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:37.299263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:37.299688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:37.434085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:37.442961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d1397fa-f043-4b2c-b600-cb5bdc04d9a1 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156938 Sep 19 12:17:37.443517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1247/2456] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:37 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:37.602922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:37.603533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:37.610316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:37.610803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:37.611234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:37.611966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:37.612436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:37.612855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:37.751908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:37.761604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:37.763068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:37.764216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30aee385-daee-4bb3-93f6-2d700809f1e2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.165214 Sep 19 12:17:37.764769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1210/2457] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:38.467147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:38.467722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:38.474816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:38.475297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:38.475729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:38.476419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:38.476864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:38.477281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:38.481400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:38.621848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:38.630226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ea191c9-3c4a-47b2-9304-46faab9bbf7a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.167297 Sep 19 12:17:38.630795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1248/2458] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:38 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:38.790632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:38.791246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:38.797854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:38.798336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:38.798766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:38.799525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:38.799971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:38.800391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:38.941328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:38.950341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:38.951830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:38.953104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fee5ada4-d774-4c20-adea-3e31e7d6a386 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.166320 Sep 19 12:17:38.953551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1211/2459] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:17:39.653899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:39.654539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:39.661787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:39.662293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:39.662748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:39.663475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:39.663925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:39.664375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:39.801078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:39.816170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5eeae6b-9827-477e-8711-5d2867e1bb15 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.166158 Sep 19 12:17:39.816755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1249/2460] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:39 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:39.979689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:39.980287 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:39.987579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:39.988070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:39.988508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:39.989224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:39.989684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:39.990139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:40.130849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:40.139884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:40.141322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:40.142570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dda827df-c529-478b-b472-091863f444fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.166920 Sep 19 12:17:40.143637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1212/2461] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:40.839936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:40.840866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:40.848088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:40.848580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:40.849018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:40.849714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:40.850204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:40.850630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:40.988522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:40.996952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57203a2f-083f-4775-bccf-7d69ef10e371 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.161125 Sep 19 12:17:40.997526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1250/2462] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:40 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:41.170603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:41.171237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:41.178753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:41.179458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:41.180059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:41.180769 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:41.181218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:41.181639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:41.323872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:41.333008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:41.334573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:41.335840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48596649-bbd0-42cb-8343-ed5d61d57247 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.169570 Sep 19 12:17:41.336406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1213/2463] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:17:42.022456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:42.023096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:42.029504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:42.030021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:42.030461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:42.031144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:42.031598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:42.032050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:42.168598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:42.178145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adb76a31-a884-4e9d-ab9c-a7b7bfc3cfa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.159953 Sep 19 12:17:42.178820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1251/2464] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:42 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:17:42.363589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:42.364203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:42.370539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:42.371016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:42.371655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:42.372349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:42.372793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:42.373228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:42.500892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:42.510175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:42.511609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:42.512911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a89f40c4-56d0-45aa-a310-34df6ae258e8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.153773 Sep 19 12:17:42.513473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1214/2465] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:43.201718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:43.202338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:43.209124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:43.209594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:43.210052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:43.210736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:43.211181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:43.211597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:43.341290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:43.350567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36288786-e5fe-41dc-9724-42806867b612 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.152612 Sep 19 12:17:43.351148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1252/2466] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:43 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:43.538811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:43.539475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:43.546553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:43.547035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:43.547468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:43.548156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:43.548604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:43.549024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:43.684827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:43.694403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:43.695831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:43.697113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-634b000b-4ac0-4c2d-9474-a12040ce9fbc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.162342 Sep 19 12:17:43.697672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1215/2467] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:44.374100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:44.374659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:44.381196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:44.381630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:44.382100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:44.382789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:44.383241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:44.383662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:44.511690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:44.520814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a497663-74e4-4c52-92d6-dc06d938e5ea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.150631 Sep 19 12:17:44.521376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1253/2468] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:44 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:44.724794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:44.725403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:44.732073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:44.732555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:44.732992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:44.733685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:44.734164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:44.734592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:44.865236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:44.873707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:44.875157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:44.876316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f8a947fe-fb38-43ed-9724-9c0883c649ce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.156124 Sep 19 12:17:44.877004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1216/2469] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:45.544574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:45.545114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:45.552056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:45.552621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:45.553873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:45.554648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:45.555117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:45.555546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:45.689627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:45.697775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c7874b1-d764-41c2-8a4f-f1c2fcb8b650 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.157195 Sep 19 12:17:45.698331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1254/2470] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:45 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:45.902812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:45.903350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:45.910528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:45.911023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:45.911459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:45.912186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:45.912637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:45.913062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:45.915764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:46.043998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:46.052518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:46.053973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:46.055125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dd74318a-5424-40d0-b6d3-e08b0c07497c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.156394 Sep 19 12:17:46.055675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1217/2471] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:46.720848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:46.721421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:46.727803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:46.728281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:46.728709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:46.729385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:46.729866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:46.730286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:46.864491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:46.873080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13a5f9bc-e851-4702-a9de-c65fdf72f731 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156125 Sep 19 12:17:46.873720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1255/2472] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:46 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:47.145513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:47.146177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:47.152117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:47.152681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:47.153222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:47.154016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:47.154514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:47.155015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:47.285590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:47.294144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:47.295560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:47.296706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b6309366-16a1-4282-b87a-1ac29d50b5cf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.220218 Sep 19 12:17:47.297254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1218/2473] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:47.897572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:47.898210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:47.904962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:47.905438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:47.905906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:47.906585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:47.907030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:47.907447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:48.040958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:48.049669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcdac5af-a86c-4adb-bb98-bc6344369984 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.155955 Sep 19 12:17:48.050278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1256/2474] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:47 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:48.322172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:48.322784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:48.329208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:48.329713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:48.330222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:48.330908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:48.331362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:48.331902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:48.457921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:48.467249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:48.468690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:48.469876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-59f856d3-c833-4a98-809c-90842a534d93 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.151609 Sep 19 12:17:48.470783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1219/2475] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:49.072540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:49.073140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:49.079870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:49.080864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:49.081300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:49.082062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:49.082524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:49.082992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:49.216604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:49.225427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b7058a5e-8932-44e5-89b5-143ba111f80e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156756 Sep 19 12:17:49.226013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1257/2476] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:49 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:49.495902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:49.496507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:49.503544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:49.504040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:49.504478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:49.505167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:49.505612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:49.506061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:49.636979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:49.647087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:49.648535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:49.649913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2850c931-fbec-4248-aa2a-1acda454c4ee tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.157756 Sep 19 12:17:49.650299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1220/2477] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:49 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:50.249063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:50.249688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:50.251714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:17:50.251843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:17:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e (ip 10.222.0.88) !!! Sep 19 12:17:50.258308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:50.258787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:50.259221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:50.259911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:50.260359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:50.260781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:50.390955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:50.399559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f425238-4be1-4705-a5cc-69b0963e39ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.154301 Sep 19 12:17:50.400065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1258/2478] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:50 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:50.676337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:50.676887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:50.683333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:50.683820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:50.684254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:50.684949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:50.685573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:50.686033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:50.829212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:50.839192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:50.840662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:50.841888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-381fd185-9fea-41e8-a9f8-2ed4dac13c94 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.169645 Sep 19 12:17:50.842459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1221/2479] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:51.424960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:51.425506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:51.432313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:51.432797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:51.433232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:51.433975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:51.434425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:51.434848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:51.582630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:51.591322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-65cf2c47-fe73-48c2-9d8e-67620201856a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.170848 Sep 19 12:17:51.591884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1259/2480] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:51 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:51.870290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:51.870995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:51.877745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:51.878258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:51.878684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:51.879406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:51.879851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:51.880267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:52.018553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:52.027451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:52.028885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:52.030094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-80e64207-2857-4ccd-ae69-912d6e73d687 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.164298 Sep 19 12:17:52.030773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1222/2481] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:52.614974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:52.615581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:52.622116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:52.622601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:52.623035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:52.623731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:52.624177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:52.624595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:52.763837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:52.772849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6471f73-58f6-4d35-ba16-8221ad4d1bb4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.162112 Sep 19 12:17:52.773809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1260/2482] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:52 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:53.056524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:53.057139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:53.063606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:53.064088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:53.065271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:53.066408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:53.066907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:53.067333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:53.208508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:53.218157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:53.219668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:53.221385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8073d4a-4160-47a9-9c13-f76cc4ad44c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.168394 Sep 19 12:17:53.225872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1223/2483] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:53.796406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:53.797021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:53.803750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:53.804242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:53.804682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:53.805379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:53.805855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:53.806285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:53.939910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:53.948653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e85e7d2-322e-468b-ac5a-4d729967fdea tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156041 Sep 19 12:17:53.949195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1261/2484] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:53 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:54.247874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:54.248491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:54.255580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:54.256045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:54.256483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:54.257174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:54.257625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:54.258083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:54.391677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:54.400379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:54.401757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:54.402970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5aace3e-efe3-4eab-a68c-4048b5ee11dc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159061 Sep 19 12:17:54.403534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1224/2485] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:54 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:54.974037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:54.974673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:54.981505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:54.982020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:54.982517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:54.983159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:54.983697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:54.984049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:55.355560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:55.365195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b9c5041-a66c-4f12-b512-a46a53c32b39 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.395778 Sep 19 12:17:55.365789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1262/2486] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:54 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:55.428499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:55.429118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:55.431495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:55.436865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:55.437358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:55.437817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:55.438522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:55.438972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:55.439397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:55.571870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:55.580471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:55.582556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:55.583713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18a5ea69-b8f4-4082-b1a7-846691f15854 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159170 Sep 19 12:17:55.584269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1225/2487] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:56.389409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:56.390042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:56.396515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:56.397136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:56.397421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:56.398201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:56.398723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:56.399193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:56.538126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:56.547112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f7d9ab2-6b03-4674-97a5-48f07befbb16 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.160909 Sep 19 12:17:56.547112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1263/2488] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:56 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:56.609886 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:56.610494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:56.617028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:56.617511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:56.617985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:56.618682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:56.619135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:56.619563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:56.807408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:56.816338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:56.818013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:56.819181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b6cf098-3e2b-4965-a570-7c3421646a50 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.213314 Sep 19 12:17:56.819736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1226/2489] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:57.569785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:57.570396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:57.577482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:57.578008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:57.578448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:57.579199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:57.579657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:57.580087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:57.716816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:57.720363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:57.725920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d271ddda-6add-45ab-9207-2249f694ea1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.160574 Sep 19 12:17:57.726488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1264/2490] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:57 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:57.845114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:57.845785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:57.853289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:57.853793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:57.854234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:57.854935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:57.855392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:57.855820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:57.986038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:57.995463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:57.996898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:57.998082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-636cfd45-f76b-4e1f-a1df-d8a8def89a56 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.156958 Sep 19 12:17:57.998646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1227/2491] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:58.749157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:58.750486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:58.752422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:17:58.758415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:58.758905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:58.759343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:58.760040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:58.760494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:58.760918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:58.889523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:58.897730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42bd80d5-fb38-401e-bb25-1f71c63f1f9e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.152602 Sep 19 12:17:58.898317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1265/2492] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:58 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:17:59.025038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:59.025982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:59.031823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:59.032307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:59.032747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:59.033444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:59.033928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:59.034357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:59.186912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:59.196431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:59.197907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:17:59.199095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-22c23eae-6d9d-40d3-bcae-c35d4ece6820 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.178360 Sep 19 12:17:59.199658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1228/2493] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:17:59 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:17:59.920927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:17:59.921528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:17:59.928916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:59.929537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:59.930004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:17:59.930704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:17:59.931154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:17:59.931577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:00.077332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:00.084745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e028e206-6fb2-4c8d-9277-826f33d465ac tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.167771 Sep 19 12:18:00.085311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1266/2494] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:17:59 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:00.227594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:00.228292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:00.234997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:00.235520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:00.235955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:00.236653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:00.237104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:00.237571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:00.390281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:00.399133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:00.400570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:00.401731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6e9e392-2ecf-44ab-bc7d-04b2514dcdd8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.178217 Sep 19 12:18:00.402623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1229/2495] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:01.108578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:01.109168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:01.115886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:01.116376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:01.116806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:01.117505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:01.117998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:01.118506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:01.255339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:01.264359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a56df73-7f5d-4733-adc1-42003180ad13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.159627 Sep 19 12:18:01.265248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1267/2496] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:01 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:01.430624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:01.431336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:01.440762 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:01.441899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:01.444641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:01.444641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:01.444641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:01.444641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:01.576653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:01.587344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:01.589244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:01.590518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2b49d1c3-87d3-459c-92d3-2560b2191056 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.163846 Sep 19 12:18:01.591088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1230/2497] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:02.289060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:02.289673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:02.296159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:02.296645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:02.297082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:02.297796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:02.298269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:02.298688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:02.439370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:02.447575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-876ea898-ecdd-4166-bb3d-50f6b032ce80 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.162923 Sep 19 12:18:02.448330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1268/2498] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:02 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:02.618087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:02.618651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:02.625186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:02.625672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:02.626142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:02.626838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:02.627294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:02.627724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:02.756093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:02.764533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:02.766005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:02.767164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96d03f0b-b61a-40a1-99d9-5c8def18a2bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.153240 Sep 19 12:18:02.767715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1231/2499] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:03.470955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:03.471561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:03.477898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:03.478377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:03.478809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:03.479486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:03.479935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:03.480354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:03.610292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:03.619395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4659a12f-a3d2-4d17-be3a-73e1c595a8ef tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.152223 Sep 19 12:18:03.619962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1269/2500] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:03 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:03.793096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:03.793704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:03.800136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:03.801202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:03.801638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:03.802371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:03.802822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:03.803243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:03.930924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:03.939735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:03.941187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:03.942370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a25a0739-ecc5-4263-a941-a682a17fa1f1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.153261 Sep 19 12:18:03.942920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1232/2501] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:04.642757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:04.643349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:04.651305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:04.651787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:04.652221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:04.652903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:04.653401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:04.653790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:04.784682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:04.793018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6619483-9c5e-4d8b-a8d6-b33b9dedd72d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.154168 Sep 19 12:18:04.793582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1270/2502] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:04 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:04.969001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:04.969568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:04.976209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:04.976698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:04.977135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:04.977865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:04.978322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:04.978751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:05.109308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:05.111671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:05.119780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:05.121219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:05.122406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9851c009-fccc-4f7d-8e8b-30701f6b7a58 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.157660 Sep 19 12:18:05.122961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1233/2503] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:05.819027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:05.819580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:05.825998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:05.826482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:05.826921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:05.827607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:05.828060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:05.828485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:05.958486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:05.969234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48980e01-17aa-4b2f-a4e3-323898b5165c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.154016 Sep 19 12:18:05.969832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1271/2504] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:05 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:06.148577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:06.149192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:06.155695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:06.156184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:06.156624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:06.157318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:06.157793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:06.158224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:06.292757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:06.301534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:06.303317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:06.304639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30e34ee4-5701-4dd0-b952-c762129d41a4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.160100 Sep 19 12:18:06.305194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1234/2505] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:06.995081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:06.995666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:07.001703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:07.002223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:07.002671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:07.003999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:07.004484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:07.004909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:07.132186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:07.140461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3520e39-6d87-43ab-b7c2-9b315bdbae6a tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.149959 Sep 19 12:18:07.141028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1272/2506] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:06 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:07.331352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:07.332011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:07.338646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:07.339129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:07.339562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:07.340252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:07.340700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:07.341122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:07.470958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:07.480147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:07.481590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:07.482777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a18dcd6-18e0-48c8-9c98-f4fd79a7b5fd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155380 Sep 19 12:18:07.483336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1235/2507] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:08.164059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:08.164669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:08.171032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:08.171506 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:08.171932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:08.172611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:08.173056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:08.173474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:08.298629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:08.307438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5538fa69-43e2-4378-95e5-4e3177d84fa8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.147801 Sep 19 12:18:08.308000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1273/2508] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:08 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:08.508735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:08.509349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:08.515773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:08.516254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:08.516690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:08.517376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:08.517865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:08.518297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:08.650952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:08.660352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:08.661801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:08.663023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-565da6d5-af50-48ae-ba67-31636905bfe2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.158186 Sep 19 12:18:08.663572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1236/2509] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:09.330622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:09.331281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:09.337881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:09.338613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:09.339050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:09.339903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:09.340691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:09.341500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:09.489169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:09.498073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4bb739f6-c933-4982-b274-17d423bbb389 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.171269 Sep 19 12:18:09.498645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1274/2510] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:09 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:09.688697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:09.689298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:09.695703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:09.696182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:09.696609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:09.697289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:09.697735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:09.698208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:09.831391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:09.840231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:09.841661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:09.842840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e50aa4c4-7a91-40a8-8a6f-29e11b70becf tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.158177 Sep 19 12:18:09.843447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1237/2511] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:10.524552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:10.525186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:10.531749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:10.532233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:10.532797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:10.533737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:10.534222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:10.534645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:10.666725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:10.675100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69a45582-198f-4d4d-92ee-b77ea1efd47f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.155189 Sep 19 12:18:10.675698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1275/2512] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:10 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:10.870118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:10.870812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:10.877635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:10.878011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:10.878557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:10.879383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:10.880528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:10.881025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:11.022044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:11.030909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:11.032398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:11.034081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc5a4534-a525-4435-9aa2-5dfbb9de8f71 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.168175 Sep 19 12:18:11.034676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1238/2513] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:11.699153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:11.699749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:11.706230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:11.706864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:11.707292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:11.708460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:11.708898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:11.709311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:11.842493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:11.851080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37354873-c3a6-46b5-931e-3d7811dba925 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.155761 Sep 19 12:18:11.851654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1276/2514] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:11 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:12.062304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:12.062910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:12.065278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:18:12.065515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 (ip 10.222.0.88) !!! Sep 19 12:18:12.072302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:12.072786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:12.073228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:12.073953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:12.074405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:12.074827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:12.204602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:12.214168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:12.215648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:12.216953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9b91cca1-bd5e-4a87-a343-b91f55aaddd1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.158480 Sep 19 12:18:12.217553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1239/2515] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:12.876804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:12.877410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:12.883773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:12.884244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:12.884678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:12.885354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:12.885821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:12.886242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:13.016306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:13.025312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ffa4676-2bae-452d-9e63-f52ea4d180c2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.152345 Sep 19 12:18:13.028886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1277/2516] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:12 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:13.244076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:13.244602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:13.251062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:13.251536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:13.251963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:13.252639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:13.253081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:13.253494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:13.395873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:13.404591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:13.406112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:13.407306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e8f9b65-ce5c-4ad0-96a4-d0c73df14ae9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.167316 Sep 19 12:18:13.407904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1240/2517] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:14.049153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:14.049868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:14.056429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:14.056912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:14.057342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:14.058058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:14.058512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:14.058933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:14.190687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:14.199383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0d3f8ed-b5b2-486f-a670-fea2cbb0e811 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.154405 Sep 19 12:18:14.199949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1278/2518] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:14 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:14.433454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:14.434106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:14.440568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:14.441048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:14.441484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:14.442746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:14.443262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:14.443658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:14.578015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:14.586526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:14.587957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:14.589373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bf45e6a1-4df8-47e0-867e-ecd5ecba17d2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159900 Sep 19 12:18:14.589950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1241/2519] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:14 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:15.224137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:15.224743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:15.231122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:15.231597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:15.232026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:15.232704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:15.233145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:15.233563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:15.367806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:15.376051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d56e779-4ee8-421a-b980-df8f495c5e8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156451 Sep 19 12:18:15.376606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1279/2520] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:15 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:15.615453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:15.616022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:15.622902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:15.623394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:15.623857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:15.624563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:15.625018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:15.625447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:15.755161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:15.763757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:15.765205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:15.766408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec0cd162-1fe3-469b-a903-73db021fd3fa tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155583 Sep 19 12:18:15.766965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1242/2521] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:16.398565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:16.399148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:16.405793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:16.406317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:16.406755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:16.407539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:16.408058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:16.408483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:16.546374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:16.555359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-219e6882-ebcf-4e42-a9ca-b4ed86d67b34 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.160820 Sep 19 12:18:16.555929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1280/2522] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:16 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:16.793067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:16.793730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:16.800395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:16.800882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:16.801384 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:16.802119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:16.802576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:16.803009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:16.931936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:16.941618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:16.944428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:16.946550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ddb21706-2ae0-4216-87ad-d55c18cdde10 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.157165 Sep 19 12:18:16.947515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1243/2523] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:17.579373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:17.579967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:17.586312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:17.586798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:17.587229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:17.587911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:17.588613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:17.589157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:17.609939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:17.731904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:17.741622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66b316fd-b7a1-4374-b649-dc2da52ddeb5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.166190 Sep 19 12:18:17.742223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1281/2524] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:17 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:17.973843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:17.974448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:17.980904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:17.981388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:17.981846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:17.982540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:17.982992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:17.983409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:18.127796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:18.136471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:18.137935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:18.139150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c17326c2-d8c1-4604-83ec-59a7ceb6184f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.169772 Sep 19 12:18:18.139703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1244/2525] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:18.764701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:18.765359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:18.772449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:18.772924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:18.773362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:18.774091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:18.774541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:18.774970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:18.908050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:18.916218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d78477c-15a9-4db9-9fc0-6457d8a73884 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.155596 Sep 19 12:18:18.916826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1282/2526] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:18 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:19.164997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:19.165602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:19.172206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:19.172689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:19.173120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:19.173831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:19.174319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:19.174743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:19.307283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:19.316235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:19.318413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:19.319603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48debe24-21a7-4b57-9a78-e8b5e93d6e5b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.158981 Sep 19 12:18:19.320157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1245/2527] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:19.939440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:19.940041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:19.946371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:19.946850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:19.947275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:19.947982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:19.947982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:19.948841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:20.078759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:20.087507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f42c1426-eac2-4230-88d3-55214f3dbbd3 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.151943 Sep 19 12:18:20.088074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1283/2528] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:19 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:20.344775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:20.345403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:20.351847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:20.352339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:20.353436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:20.354341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:20.354654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:20.355205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:20.498329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:20.507802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:20.509232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:20.510448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39405d87-f315-4e08-ad0f-59de0f06febe tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.169643 Sep 19 12:18:20.511655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1246/2529] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:20 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:21.110793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:21.111401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:21.118518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:21.118993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:21.119422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:21.120099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:21.120543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:21.120960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:21.249603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:21.257876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47d234c2-a7e8-4ee4-a973-9fe02c11b77e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.150975 Sep 19 12:18:21.258429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1284/2530] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:21 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:21.537926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:21.538563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:21.545129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:21.545615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:21.546091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:21.546789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:21.547239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:21.547665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:21.684526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:21.693692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:21.695155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:21.696315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7786cf82-bff2-4bdb-b79e-ff08503378ea tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.163283 Sep 19 12:18:21.696885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1247/2531] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:22.281469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:22.282172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:22.284410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:18:22.284556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e (ip 10.222.0.88) !!! Sep 19 12:18:22.295926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:22.296406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:22.296839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:22.297528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:22.298071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:22.298496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:22.431947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:22.440356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-836d70c0-cf26-449e-8487-080543c844e7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.162948 Sep 19 12:18:22.440931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1285/2532] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:22 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:22.723895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:22.724530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:22.731954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:22.732657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:22.733352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:22.734108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:22.734566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:22.734994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:22.864223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:22.873248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:22.874746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:22.875912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f033c923-12f7-443c-9fa3-ee54e35abd29 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.156765 Sep 19 12:18:22.876473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1248/2533] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:23.470960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:23.471528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:23.477832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:23.478329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:23.478763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:23.479443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:23.479888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:23.480307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:23.616949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:23.625532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b1a14b7-eb86-4248-9560-224040f06e99 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.158683 Sep 19 12:18:23.626215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1286/2534] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:23 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:23.901439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:23.902087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:23.908560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:23.909035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:23.909463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:23.910175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:23.910623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:23.911043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:24.038477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:24.046975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:24.048411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:24.049564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-78fa2172-575d-4526-9219-6e4cf6902640 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.152031 Sep 19 12:18:24.050152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1249/2535] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:24.649010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:24.649618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:24.655707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:24.656179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:24.656604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:24.657284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:24.657733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:24.658174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:24.791448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:24.800878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff3becdc-8a85-4717-a310-863f59a75d1e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156329 Sep 19 12:18:24.801448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1287/2536] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:24 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:25.076910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:25.077536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:25.084044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:25.084529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:25.084969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:25.085686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:25.086198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:25.086625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:25.101556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:25.221864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:25.230897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:25.232322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:25.233475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c0e3cc9f-9917-4147-87b6-dc220f589c20 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.160533 Sep 19 12:18:25.234095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1250/2537] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:25.824091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:25.824695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:25.831059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:25.831535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:25.831963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:25.832643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:25.833087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:25.833559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:25.970698 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:25.979678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bfe405b-4bc7-4e87-845b-149c97dbb3d6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.159448 Sep 19 12:18:25.980245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1288/2538] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:25 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:26.260263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:26.260984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:26.263175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=52 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:26.268634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:26.269123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:26.269562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:26.270278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:26.270725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:26.271155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:26.402957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:26.412604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:26.414057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:26.415215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39180878-f2a3-4401-8a86-e41e8a8f0804 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159644 Sep 19 12:18:26.415772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1251/2539] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:26 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:27.002619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:27.003231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:27.010314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:27.010795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:27.011225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:27.011929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:27.012378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:27.012799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:27.142355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:27.150947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e800d6f-7012-4ac9-804e-433d5e6b641d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.152103 Sep 19 12:18:27.151890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1289/2540] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:26 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:27.440757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:27.441402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:27.447884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:27.448442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:27.448854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:27.449551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:27.450031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:27.450458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:27.598569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:27.608389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:27.609859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:27.611044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6c22f19e-40cb-43df-abb1-26099e1943c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.174389 Sep 19 12:18:27.611613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1252/2541] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:28.175767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:28.176415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:28.182829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:28.183314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:28.183754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:28.184443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:28.184898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:28.185320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:28.320580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:28.329278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-33511794-741a-45ca-8c58-a42530db2be7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.157263 Sep 19 12:18:28.329881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1290/2542] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:28 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:28.637477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:28.638776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:28.644913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:28.645460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:28.645938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:28.646647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:28.647357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:28.647508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:28.787193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:28.796336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:28.797815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:28.799122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2aac587f-afe3-4014-ab5f-60a8416af693 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.166249 Sep 19 12:18:28.799681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1253/2543] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:29.353191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:29.353880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:29.356403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:29.363044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:29.363969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:29.364779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:29.365783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:29.366365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:29.366917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:29.516112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:29.526410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-433d47f0-72a9-44f8-854b-907b03000886 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.177434 Sep 19 12:18:29.527060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1291/2544] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:29 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:29.824579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:29.825337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:29.832113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:29.832618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:29.833051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:29.833783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:29.834257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:29.834714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:29.992471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:30.008061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:30.010445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:30.012415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71232fa1-46f4-4a6e-8a99-9de9fa577b4a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.191260 Sep 19 12:18:30.013314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1254/2545] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:30.561289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:30.562298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:30.572801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:30.573483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:30.574046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:30.575598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:30.576106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:30.576689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:30.737674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:30.748162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d4e265a-9fae-4907-8ce7-4f527c22e74e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.194604 Sep 19 12:18:30.748741 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1292/2546] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:30 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:31.042856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:31.044574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:31.052900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:31.053614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:31.053985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:31.054692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:31.055425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:31.055888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:31.198560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:31.208093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:31.209531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:31.210729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-09492131-48c7-4add-9193-39d0f321d939 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.175483 Sep 19 12:18:31.211286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1255/2547] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:31.782358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:31.783157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:31.789678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:31.790193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:31.790623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:31.791305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:31.791745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:31.792162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:31.960427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:31.969811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ce2eece-6ff9-4e6d-8e4f-cac6f08030d4 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.191379 Sep 19 12:18:31.970398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1293/2548] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:31 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:32.238289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:32.238944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:32.246053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:32.246576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:32.247382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:32.248106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:32.248567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:32.248996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:32.426441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:32.437962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:32.439413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:32.440607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-274aca78-0db4-449a-8439-4db538358727 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.206286 Sep 19 12:18:32.441185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1256/2549] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:32.994895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:32.995504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:33.002487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:33.002968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:33.003397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:33.004092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:33.004538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:33.004958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:33.156881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:33.166497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8158d9cd-0cda-48ea-98b8-8d7787445285 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.175320 Sep 19 12:18:33.167101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1294/2550] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:32 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:33.470148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:33.470715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:33.477142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:33.477625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:33.478101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:33.478783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:33.479237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:33.479650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:33.613406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:33.625633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:33.628132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:33.629071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c99954e-e76d-466b-b1b3-32b43a747811 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.162968 Sep 19 12:18:33.629634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1257/2551] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:33 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:34.190556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:34.191189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:34.197596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:34.198111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:34.198593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:34.199309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:34.199761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:34.200178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:34.367500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:34.383329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f32e4a54-1d5c-4062-9b88-d251235f4549 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.196261 Sep 19 12:18:34.384318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1295/2552] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:34 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:34.655319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:34.655945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:34.662757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:34.663246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:34.663710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:34.664380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:34.664828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:34.665250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:34.805337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:34.814461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:34.815887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:34.817073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9fed77d-1aef-4bd4-ad51-54d735822bc6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.166375 Sep 19 12:18:34.817649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1258/2553] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:35.415249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:35.416293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:35.425956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:35.426615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:35.427214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:35.428384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:35.429134 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:35.429573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:35.590660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:35.603427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75b3a35f-9f80-430c-97bd-dd13bf1163cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.194500 Sep 19 12:18:35.604299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1296/2554] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:35 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:35.844225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:35.845068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:35.852759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:35.853307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:35.853749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:35.854485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:35.854944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:35.855445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:36.010513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:36.021551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:36.023050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:36.024216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-babf519b-e601-4f9e-9510-c5e1a11fc265 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.184162 Sep 19 12:18:36.024767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1259/2555] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:36.630126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:36.630691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:36.637078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:36.637670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:36.638016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:36.638705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:36.639154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:36.639567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:36.773409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:36.782504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c59c1f9-b7ce-42c7-baa1-64819bb8e56e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156303 Sep 19 12:18:36.782953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1297/2556] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:36 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:37.052770 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:37.053574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:37.060864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:37.061388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:37.061848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:37.062566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:37.063020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:37.063451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:37.207425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:37.219029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:37.221520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:37.223455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-200f9751-8fae-43d9-8731-80cd9ddcabe4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.174576 Sep 19 12:18:37.224349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1260/2557] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:37.804553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:37.805217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:37.812285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:37.812761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:37.813186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:37.813901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:37.814348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:37.814759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:37.818934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:37.986049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:37.997068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8dcf334-b976-45de-9c87-4c487dca502b tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.196310 Sep 19 12:18:37.997662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1298/2558] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:37 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:38.253715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:38.254919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:38.260843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:38.261205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:38.262179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:38.262950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:38.263401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:38.263830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:38.416780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:38.430281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:38.432073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:38.433659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a0618a50-1fc4-4c83-9171-652936f42881 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.183667 Sep 19 12:18:38.434455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1261/2559] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:39.026227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:39.026858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:39.034979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:39.035458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:39.035883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:39.036578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:39.037018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:39.037431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:39.177197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:39.191737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-114daf23-0e93-4386-a4e5-a486bafcf2a5 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.169509 Sep 19 12:18:39.192313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1299/2560] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:39 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:39.462378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:39.462999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:39.470037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:39.470552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:39.470995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:39.471730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:39.472183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:39.472609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:39.610342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:39.619442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:39.620888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:39.622654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9bd71ac9-6465-48a6-a5ca-e56dcc476a04 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.163992 Sep 19 12:18:39.623729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1262/2561] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:39 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:40.217952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:40.218603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:40.224944 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:40.225429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:40.225911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:40.226604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:40.227055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:40.227483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:40.363943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:40.372397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e0eaa22-39dd-4048-a625-3f50478f2eab tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.158871 Sep 19 12:18:40.373235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1300/2562] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:40 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:40.650461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:40.651160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:40.658397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:40.659019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:40.659329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:40.660026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:40.660504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:40.660960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:40.804798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:40.815152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:40.816576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:40.817740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-747f469f-1991-47d9-bcc8-78ffff19e620 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.171633 Sep 19 12:18:40.818323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1263/2563] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:18:41.396357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:41.396967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:41.407366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:41.408483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:41.408989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:41.410150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:41.411195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:41.412007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:41.580446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:41.592631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e408738b-1f8b-476a-b245-2bbe943d2595 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.199739 Sep 19 12:18:41.593659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1301/2564] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:41 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:41.844800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:41.845637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:41.852495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:41.852991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:41.853428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:41.854173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:41.854622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:41.855053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:42.000431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:42.012112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:42.014728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:42.015154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-65b9dbe1-ee39-4b1d-9105-5143d0ce4e89 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.174749 Sep 19 12:18:42.015721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1264/2565] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:42.623505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:42.624120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:42.630755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:42.631237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:42.631663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:42.632404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:42.632891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:42.633350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:42.797247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:42.805639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74586d36-e670-4336-a3c4-0dea0584b3b6 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.186123 Sep 19 12:18:42.806495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1302/2566] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:42 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:43.040944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:43.041718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:43.049002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:43.049822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:43.050278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:43.051238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:43.051793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:43.052359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:43.199075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:43.208295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:43.209756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:43.210927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b5fce8bd-6452-43b3-b658-e9bf255d8db1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.174013 Sep 19 12:18:43.211480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1265/2567] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:43 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:43.831067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:43.831699 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:43.838549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:43.839032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:43.839468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:43.840165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:43.840616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:43.841042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:44.020401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:44.031822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f0ae1df-70a0-4825-9c99-901403698a8e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.204298 Sep 19 12:18:44.032818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1303/2568] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:43 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:44.238012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:44.238641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:44.249453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:44.249975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:44.250407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:44.251095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:44.251540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:44.251956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:44.397292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:44.408632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:44.410005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:44.411193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8d7771f0-8f45-43fa-bef1-ba614f21d1a2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.177289 Sep 19 12:18:44.411748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1266/2569] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:44 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:45.060839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:45.061463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:45.068007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:45.068498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:45.068932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:45.069644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:45.070130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:45.070554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:45.212821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:45.221922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f700f3f-baad-4500-b43c-4b08accf5357 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.165468 Sep 19 12:18:45.222546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1304/2570] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:45 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:45.437165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:45.437862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:45.444441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:45.444927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:45.445369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:45.446102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:45.446558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:45.446983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:45.449594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:45.578280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:45.586827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:45.588531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:45.589700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7151ab13-9ae7-4fef-948a-0c82656841b2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.156492 Sep 19 12:18:45.590303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1267/2571] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:45 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:46.248181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:46.248873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:46.255251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:46.255733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:46.256170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:46.256866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:46.257318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:46.257742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:46.395956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:46.404942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-209c4c6f-f013-40bc-b60b-ef8e42ac22a8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.161095 Sep 19 12:18:46.405534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1305/2572] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:46 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:46.616542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:46.617186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:46.624149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:46.624638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:46.625079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:46.625826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:46.626285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:46.626712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:46.767642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:46.776626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:46.778728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:46.779939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-30a7ab38-ddf6-4b94-8810-9b3a74b13c49 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.167351 Sep 19 12:18:46.780501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1268/2573] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:46 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:47.431161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:47.431745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:47.438916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:47.439395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:47.439830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:47.440514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:47.440962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:47.441389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:47.577530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:47.585722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14511d17-b46d-4507-b478-087c5402b59e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.158834 Sep 19 12:18:47.586315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1306/2574] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:47 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:47.808669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:47.809876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:47.818088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:47.818585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:47.819030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:47.819741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:47.820200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:47.820635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:47.965971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:47.974718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:47.976168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:47.977380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e03ce2fa-4255-4cda-b4e2-3085fedbfb0f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.172555 Sep 19 12:18:47.977971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1269/2575] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:47 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:48.610865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:48.611557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:48.618383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:48.618871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:48.619312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:48.620011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:48.620468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:48.620894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:48.760680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:48.770955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05dd83b9-bf8e-482e-9d83-7e75b2f643ba tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.164384 Sep 19 12:18:48.771624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1307/2576] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:48 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:49.003469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:49.004082 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:49.010568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:49.011056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:49.011491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:49.012676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:49.013324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:49.013754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:49.178085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:49.190220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:49.191671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:49.192826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-364a5cf9-2113-49c4-9e24-09cbea4987eb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.193332 Sep 19 12:18:49.193398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1270/2577] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:48 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:49.795898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:49.796478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:49.803514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:49.804016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:49.804531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:49.805386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:49.805942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:49.806449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:49.977192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:49.987345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06aa71dd-4061-44ab-8236-ee7cb3c645aa tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.195846 Sep 19 12:18:49.988151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1308/2578] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:49 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:50.221029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:50.221655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:50.228423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:50.228908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:50.229344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:50.230089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:50.230548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:50.232166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:50.428088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:50.437827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:50.439268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:50.440471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c2a9ccca-e69a-4f56-b74b-6ca6e3fb55a9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.223664 Sep 19 12:18:50.441028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1271/2579] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:50 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:18:51.013480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:51.014382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:51.023192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:51.023771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:51.024392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:51.025555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:51.026382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:51.027101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:51.201312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:51.210260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca84273f-80a9-40d5-a1cd-e3cf5b85c72e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.202987 Sep 19 12:18:51.210833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1309/2580] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:51 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:51.468869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:51.469632 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:51.476465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:51.476957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:51.477396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:51.478139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:51.478596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:51.479027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:51.626619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:51.636241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:51.638399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:51.639580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-40433d9d-ea68-4d42-9db2-086c05cd8306 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.175655 Sep 19 12:18:51.640214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1272/2581] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:51 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:52.246954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:52.248263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:52.255959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:52.256562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:52.256999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:52.257719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:52.258243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:52.258672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:52.399904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:52.408787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c260de7-0550-4bfe-aab5-d9d627ddc02c tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.169045 Sep 19 12:18:52.409685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1310/2582] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:52 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:52.672824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:52.673416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:52.680069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:52.680735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:52.681169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:52.681945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:52.682396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:52.682829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:52.826483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:52.839792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:52.841875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:52.843625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-92818ec0-53d7-4396-a103-f06a98f0732b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.175261 Sep 19 12:18:52.844478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1273/2583] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:52 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:18:53.439267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:53.439834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:53.446436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:53.446916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:53.447347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:53.448039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:53.448482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:53.448901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:53.645130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:53.658206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76851222-b90e-4bf5-840e-39aa8cd76e9f tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.222926 Sep 19 12:18:53.659124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1311/2584] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:53 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:53.871213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:53.872018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:53.879020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:53.879626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:53.880110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:53.880808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:53.881257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:53.881681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:54.052228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:54.061608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:54.066941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:54.069133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e7328118-c87a-4ef5-a077-aefa585268b5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.201749 Sep 19 12:18:54.070369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1274/2585] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:53 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:54.692659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:54.693396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:54.700378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:54.700862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:54.701292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:54.702024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:54.702476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:54.702895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:54.852685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:54.862517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e79d594-44cf-4001-9987-1af0e07bb11e tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.173618 Sep 19 12:18:54.863103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1312/2586] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:54 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:18:55.099269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:55.100152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:55.110009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:55.110561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:55.111087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:55.112168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:55.113038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:55.113700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:55.506514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:55.519884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:55.523259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:55.524181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9df1e81a-3a3f-4f11-a8dd-1205baa30d87 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.431088 Sep 19 12:18:55.525180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1275/2587] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:55 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:55.886629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:55.887864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:55.894645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:55.895126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:55.895565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:55.896270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:55.896724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:55.897148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:56.043943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:56.052574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a8cc5f4-1526-42db-95dc-ae6a80eaa224 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.169933 Sep 19 12:18:56.053157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1313/2588] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:55 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:56.562687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:56.563541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:56.565586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:56.571205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:56.571687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:56.572133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:56.572803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:56.573250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:56.573662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:56.730050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:56.740093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:56.741685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:56.743316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc4aa0c0-62c1-41ff-82a3-3795f8499e9a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.185235 Sep 19 12:18:56.743970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1276/2589] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:56 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:57.161383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:57.162166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:57.168514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:57.168997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:57.169453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:57.170161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:57.170669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:57.171094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:57.331624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:57.335459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:18:57.343023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97c5689b-7ee7-4a42-8c2c-f3a6207918cd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.269627 Sep 19 12:18:57.343655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1314/2590] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:57 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:57.781130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:57.781757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:57.788638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:57.789129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:57.789567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:57.790308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:57.790766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:57.791195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:57.931917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:57.941273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:57.942752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:57.943919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-454de3cf-26d2-438f-97b7-d6964f61d08f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.166904 Sep 19 12:18:57.944485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1277/2591] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:57 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:58.373476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:58.374424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:58.382372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:58.382857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:58.383285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:58.383977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:58.384421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:58.384840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:58.540523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:58.549519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93794b22-63c1-4ca8-bb28-b587c2d83d13 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.181560 Sep 19 12:18:58.550129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1315/2592] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:58 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:18:58.969098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:58.969693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:58.975619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:58.976101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:58.976538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:58.977228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:58.977681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:58.978136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:59.108862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:59.117625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:59.119086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:59.120237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb796557-d3f9-4a62-8e30-32ed9afaadce tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155263 Sep 19 12:18:59.120796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1278/2593] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:18:58 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:18:59.573017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:18:59.573628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:18:59.580357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:59.580841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:59.581275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:59.582026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:18:59.582489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:18:59.582915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:18:59.722577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:18:59.730920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37e6845d-ddb7-4c90-9a6b-6200035951cf tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.162291 Sep 19 12:18:59.731484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1316/2594] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:18:59 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:00.147634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:00.148669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:00.155371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:00.155855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:00.156286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:00.156977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:00.157435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:00.157876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:00.284945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:00.293496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:00.295116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:00.296281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fcac49d4-869f-453b-abbb-f5429a6b20f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.152650 Sep 19 12:19:00.296842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1279/2595] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:00 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:00.754519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:00.755131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:00.757401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:00.763053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:00.763533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:00.763964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:00.764650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:00.765099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:00.765519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:00.894485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:00.902674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5755da1c-f4c7-40b9-b220-fd3d34a1bcec tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.152064 Sep 19 12:19:00.903240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1317/2596] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:00 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:01.322232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:01.322840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:01.329266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:01.329740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:01.330200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:01.330876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:01.331320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:01.331771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:01.458073 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:01.467364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:01.468795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:01.470004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bbefff6f-d36b-4d2c-bf76-eca29201fb7d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.151675 Sep 19 12:19:01.470560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1280/2597] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:01 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:01.925900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:01.926512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:01.932912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:01.933392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:01.933847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:01.934538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:01.935497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:01.935921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:02.069525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:02.078397 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-facfcbe1-f13e-4d17-9ea2-c55bcb0f57f8 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.156385 Sep 19 12:19:02.078945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1318/2598] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:01 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:02.495400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:02.495994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:02.502933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:02.503414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:02.503848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:02.504533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:02.504991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:02.505411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:02.632790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:02.641301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:02.642766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:02.643929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6da6dd9-de71-4b45-8c10-5bc88bf8075c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.152480 Sep 19 12:19:02.644488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1281/2599] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:02 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:03.101585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:03.102592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:03.109242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:03.109731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:03.110224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:03.110927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:03.111388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:03.111997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:03.240167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:03.248503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b75b79da-c8da-4d07-8b6c-9f3d291aecfd tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.150907 Sep 19 12:19:03.249070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1319/2600] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:03 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:03.669913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:03.670518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:03.677704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:03.678208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:03.678640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:03.679326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:03.679780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:03.680197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:03.811272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:03.819893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:03.821340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:03.822544 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-acc8fe40-1178-4ce4-b755-030c16e52cbb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.156647 Sep 19 12:19:03.823104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1282/2601] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:03 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:04.271732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:04.272337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:04.279283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:04.279755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:04.280186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:04.280863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:04.281304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:04.281719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:04.414222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:04.423261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47d5d347-4be4-44f5-a8eb-bd0f65a12ea7 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.155290 Sep 19 12:19:04.424370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1320/2602] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:04 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:04.848234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:04.848918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:04.855349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:04.855832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:04.856273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:04.856959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:04.857414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:04.857874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:04.992370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:04.995142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:05.003169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:05.004588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:05.005737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e33f390f-a45f-4cae-815b-4cec7dcaa4d0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.161423 Sep 19 12:19:05.006327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1283/2603] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:04 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:05.383271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e71a69a-a6b6-40e5-bf86-40d4596c444e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] Calling method '.version_select at 0x7f4ff6e5d670>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:05.412163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e71a69a-a6b6-40e5-bf86-40d4596c444e tempest-TestVolumeBootPattern-578111480 tempest-TestVolumeBootPattern-578111480-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2116099399" status: 202 len: 0 microversion: 2.1 time: 0.032678 Sep 19 12:19:05.412742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1321/2604] 10.222.0.88 () {58 vars in 1263 bytes} [Mon Sep 19 12:19:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2116099399 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:19:05.447065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:05.447681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:05.453902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:05.454421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:05.454850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:05.455550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:05.456012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:05.456440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:05.600525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:05.609588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff024885-d2d9-4e99-aebe-1ac24d3f1263 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.166514 Sep 19 12:19:05.610204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1284/2605] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:05 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:06.032723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:06.033329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:06.052468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:06.052468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:06.052468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:06.052468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:06.053223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:06.053223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:06.277177 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:06.287109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:06.288591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:06.289820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c54b7aa-6945-4da5-9c72-9e33a7992ce1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.261666 Sep 19 12:19:06.302219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1322/2606] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:06 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:06.632554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:06.633230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:06.641058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:06.641754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:06.642276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:06.643109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:06.643686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:06.644113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:06.898499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:06.907807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b0c2e63-43c5-4748-a43c-9939c0561c1d tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.279072 Sep 19 12:19:06.908389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1285/2607] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:06 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:07.316302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:07.318482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:07.336658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:07.338371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:07.338931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:07.339764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:07.340588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:07.341943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:07.770101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:07.782634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:07.784106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:07.785340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3e6ed09-6c75-47de-b471-d4cb51df5cae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.472942 Sep 19 12:19:07.787568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1323/2608] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:07 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:07.936166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:07.936862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:07.943040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:07.943722 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:07.944162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:07.944858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:07.945318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:07.945734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:08.152786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:08.162671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d7e12218-6d64-42c1-b08d-d4341026dddb tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.233552 Sep 19 12:19:08.163526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1286/2609] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:07 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:08.811964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:08.812538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:08.819315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:08.819807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:08.820252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:08.820951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:08.821597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:08.822051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:09.035778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:09.052042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:09.053481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:09.054669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30243931-70f0-4098-b9e9-399e0effd0e7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.247386 Sep 19 12:19:09.055531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1324/2610] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:08 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:09.188225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:09.188846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:09.195729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:09.196310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:09.196988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:09.197898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:09.198361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:09.198793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:09.425711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:09.434546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3bde65f-0e0d-43dd-9174-40dbfc9cb035 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.250353 Sep 19 12:19:09.435116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1287/2611] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:09 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:10.080995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:10.081618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:10.088474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.088965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.089402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:10.090146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.090601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.091028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:10.298610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:10.308662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:10.311000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:10.312429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4e38e24-3373-4add-9daf-0c14a37b584a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.235329 Sep 19 12:19:10.312983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1325/2612] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:10 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:10.369872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:10.370421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:10.377087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.377577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.378049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:10.378745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.379251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.379668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:10.412275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:19:10.464869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:10.466433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:10.472828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.473600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.474232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:10.475106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.475722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.476338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:10.542272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df788769-173f-4b18-853e-399db900fb42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 204 len: 0 microversion: 2.1 time: 0.175927 Sep 19 12:19:10.542908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1288/2613] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:19:10 2022] DELETE /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:19:10.551595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:10.552456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:10.558430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.559162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.560339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:10.561223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:10.562497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:10.563110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:11.003450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:11.011780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3479b07-63d1-4c72-9723-a6adaf174874 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.550948 Sep 19 12:19:11.012559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1326/2614] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:10 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:11.031348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:11.039588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2c000d5a-5f76-452c-9b5e-3d4a2eab5003 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1719 microversion: 2.1 time: 0.492055 Sep 19 12:19:11.040169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1289/2615] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1719 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:19:11.343339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:11.344575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:11.351989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:11.353052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:11.353854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:11.354764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:11.355522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:11.356120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:11.621395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:11.632788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:11.643429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:11.657871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30de4f85-5535-47a2-a8a0-d1ef59e95578 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.308662 Sep 19 12:19:11.657871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1327/2616] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:11 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:12.036924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:12.037596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] [instance: 6e8311d2-58be-42df-b177-55a98bebcb2e] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:12.050345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:12.051560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:12.052329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:12.053695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:12.054338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:12.055002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:12.067783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:12.068834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:12.077450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:12.077986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:12.078653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:12.079782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:12.080249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:12.080866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:12.240982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:12.274496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5887e84d-df76-4599-88da-e98461c49d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1652 microversion: 2.1 time: 0.210763 Sep 19 12:19:12.276521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1328/2617] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1652 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:12.391052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-72ff9d00-dc53-4f86-9aae-e04cf1391696 req-ebb6acec-ce2c-44e5-8d4a-11d0634c81f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad06da9-6475-4fc6-a5f2-a98250348a27", "name": "network-vif-deleted", "tag": "4cdd9a24-9763-4015-81ba-89f136665b2a"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:12.404870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-72ff9d00-dc53-4f86-9aae-e04cf1391696 req-ebb6acec-ce2c-44e5-8d4a-11d0634c81f1 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:12.405359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-72ff9d00-dc53-4f86-9aae-e04cf1391696 req-ebb6acec-ce2c-44e5-8d4a-11d0634c81f1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:12.409870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-72ff9d00-dc53-4f86-9aae-e04cf1391696 req-ebb6acec-ce2c-44e5-8d4a-11d0634c81f1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:12.427175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-72ff9d00-dc53-4f86-9aae-e04cf1391696 req-ebb6acec-ce2c-44e5-8d4a-11d0634c81f1 service nova] Creating event network-vif-deleted:4cdd9a24-9763-4015-81ba-89f136665b2a for instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 on hv-cinder-85829 Sep 19 12:19:12.435049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-72ff9d00-dc53-4f86-9aae-e04cf1391696 req-ebb6acec-ce2c-44e5-8d4a-11d0634c81f1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155053 Sep 19 12:19:12.436306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1329/2618] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:12.550293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828f876065e4413f9447efb451cb5371', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0aec947283643dd9dfdce33a7b2799e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:12.560127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-989a72bf-601d-4474-8acf-18ae94a4aad2 tempest-VolumesSnapshotTestJSON-1018589187 tempest-VolumesSnapshotTestJSON-1018589187-project] 10.222.0.88 "GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e" status: 200 len: 1559 microversion: 2.1 time: 0.528058 Sep 19 12:19:12.561733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1290/2619] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:12 2022] GET /compute/v2.1/servers/6e8311d2-58be-42df-b177-55a98bebcb2e => generated 1559 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:12.672871 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:12.674434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:12.681052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:12.681756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:12.682406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:12.683281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:12.683942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:12.684568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:12.885434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:12.897474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:12.899061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:12.900357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4628a4f1-9a72-4604-88f4-7bac451a767e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.231887 Sep 19 12:19:12.900990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1330/2620] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:12 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:13.305218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:13.306159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:13.320218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:13.320726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:13.326414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:13.326414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:13.327610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:13.327610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:13.415267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:13.425284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-82a5c90c-4dbb-43c2-afe4-872f846d61b9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.124074 Sep 19 12:19:13.426254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1291/2621] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:13.929615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:13.930440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:13.937240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:13.937727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:13.938195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:13.938886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:13.939334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:13.939753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:14.122667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:14.132585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:14.134064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:14.135638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-117fe25d-2791-4805-9a49-398aa0783733 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.211768 Sep 19 12:19:14.136216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1331/2622] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:13 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:14.450519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:14.451172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:14.458140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:14.458633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:14.459879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:14.459879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:14.460219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:14.460643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:14.524852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:14.533866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d549bef3-ca7b-45e7-bffb-6a4fbae85970 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087963 Sep 19 12:19:14.534467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1292/2623] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:15.163094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:15.164668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:15.172445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:15.173269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:15.174004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:15.174966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:15.175423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:15.175847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:15.314526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:15.323244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:15.324665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:15.326504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4541bd1a-cca8-4c93-8478-03bf85e5b6d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.167488 Sep 19 12:19:15.327058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1332/2624] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:15 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:15.561471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:15.562142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:15.568647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:15.569128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:15.569561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:15.570277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:15.570730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:15.571156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:15.632385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:15.640612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-05ff689f-12cd-4cff-98ed-e6d6f3c9b764 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083781 Sep 19 12:19:15.641184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1293/2625] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:16.351682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:16.352311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:16.359499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:16.359982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:16.360415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:16.361110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:16.361565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:16.362018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:16.367310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:16.500170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:16.509343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:16.510818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:16.511995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c575a81-e2c7-4daa-be28-12b129682ace tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.164236 Sep 19 12:19:16.513062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1333/2626] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:16 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:16.663947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:16.664541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:16.671048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:16.671479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:16.671920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:16.672615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:16.673095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:16.673502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:16.737372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:16.745559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d4da0654-9a91-4915-81aa-2bf12d8689c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085497 Sep 19 12:19:16.746166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1294/2627] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:17.538532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:17.539167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:17.545588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:17.546111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:17.546546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:17.547237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:17.547692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:17.548119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:17.685463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:17.694274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:17.695744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:17.696908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab592616-2453-4bed-a5fa-d9574932cccd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.162277 Sep 19 12:19:17.697467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1334/2628] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:17 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:17.769739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:17.770626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:17.776548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:17.777236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:17.777825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:17.778596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:17.779029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:17.779456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:17.845382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:17.853635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c3b0f312-cbab-4435-a9e4-8d5d29e36a29 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087960 Sep 19 12:19:17.854247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1295/2629] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:18.724629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:18.725216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:18.732332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:18.732886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:18.733582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:18.734352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:18.734740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:18.735178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:18.878649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:18.879378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:18.883700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:18.886578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:18.887075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:18.887509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:18.888226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:18.889320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:18.889751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:18.895127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:18.896878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:18.898885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4c5774d-f3cf-4c91-872d-30e9eb7074bd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.178347 Sep 19 12:19:18.899461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1335/2630] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:18 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:18.958200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:18.967977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e88e83da-9ca2-42f4-96d0-1272000d3d49 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.093202 Sep 19 12:19:18.968572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1296/2631] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:19.929150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:19.930184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:19.937614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:19.938135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:19.938565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:19.939255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:19.939705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:19.940131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:19.991768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:19.992402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:19.999516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:20.000005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:20.000439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:20.001140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:20.001594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:20.002044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:20.075163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:20.084166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-dfa14b82-4b53-41c0-8ffd-72db5f21b575 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.096169 Sep 19 12:19:20.084754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1297/2632] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:19:20.100411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:20.109355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:20.110844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:20.112062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eadd73a9-f06f-4066-9858-8c5e0afc82ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.189921 Sep 19 12:19:20.112625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1336/2633] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:19 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:21.108049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:21.108678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:21.115669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:21.116151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:21.116583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:21.117267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:21.117720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:21.118207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:21.138277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:21.139557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:21.146292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:21.146784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:21.147222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:21.147923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:21.149069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:21.149069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:21.184756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:21.187801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:21.195943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cef39dea-8286-4d96-8048-9849c9599498 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091770 Sep 19 12:19:21.197797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1298/2634] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:21.287620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:21.297055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:21.298541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:21.299711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-828eb961-959e-4c08-8ec4-8df1602d1a8b tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.165310 Sep 19 12:19:21.300271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1337/2635] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:21 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:19:22.221459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:22.222095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:22.229992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:22.230483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:22.230925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:22.231627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:22.232086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:22.233145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:22.298815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:22.307110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db4ddd41-f1c1-47b4-a8e1-c28ddadba068 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090944 Sep 19 12:19:22.307685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1299/2636] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:22.326100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:22.326706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:22.333101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:22.333588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:22.334060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:22.334751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:22.335200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:22.335653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:22.467825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:22.476379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:22.478019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:22.479182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9dd57bfb-fd2f-493b-952f-a82aea21d20c tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.157147 Sep 19 12:19:22.479735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1338/2637] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:22 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:23.330716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:23.331322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:23.337699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:23.338471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:23.338905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:23.339594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:23.340048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:23.340470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:23.401893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:23.410561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6252eeae-81a4-45d8-85ed-81d305bd38e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083707 Sep 19 12:19:23.411128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1300/2638] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:23.505069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:23.505676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:23.512200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:23.512681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:23.513117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:23.513824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:23.514279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:23.514706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:23.644706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:23.653315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:23.655268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:23.656411 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95910071-4574-46da-a6b8-c42076bca59f tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155272 Sep 19 12:19:23.656955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1339/2639] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:23 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:24.434582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:24.435759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:24.437657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:19:24.437830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:19:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:19:24.444746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:24.445229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:24.445877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:24.446584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:24.447031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:24.447451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:24.517061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:24.525641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e8dea5fd-c467-43cb-94ab-e0c6c8b16f6a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.095026 Sep 19 12:19:24.526258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1301/2640] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:24.682597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:24.683211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:24.690304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:24.690729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:24.691176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:24.691872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:24.692328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:24.692758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:24.826430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:24.835035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:24.836463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:24.837618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c17ba2d5-7574-4a11-af8e-f62f87cac3d4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159051 Sep 19 12:19:24.838475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1340/2641] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:24 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:25.548601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:25.549235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:25.555714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:25.556190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:25.556621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:25.557311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:25.557757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:25.558206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:25.620381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:25.628718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9d98f5d7-8356-4225-9714-28728f081d02 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084100 Sep 19 12:19:25.629280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1302/2642] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:25.863497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:25.864062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:25.871437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:25.871915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:25.872347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:25.873533 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:25.874008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:25.874429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:26.006347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:26.015869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:26.017296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:26.018483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e828c6dc-3d97-49cd-ae68-416b2dfbddc8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159092 Sep 19 12:19:26.019034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1341/2643] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:25 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:26.652014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:26.652622 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:26.655432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:26.660548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:26.661025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:26.661454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:26.662161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:26.662635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:26.663052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:26.727597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:26.736551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-633303e2-b52d-4e60-933d-834297a4818f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088377 Sep 19 12:19:26.737117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1303/2644] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:27.044622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:27.045242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:27.051776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:27.052336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:27.052778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:27.053494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:27.053990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:27.054422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:27.184677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:27.193346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:27.194830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:27.195998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca1ba645-9ed8-443c-9268-dfbcd19fbb53 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155306 Sep 19 12:19:27.196615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1342/2645] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:27 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:19:27.759517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:27.760123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:27.766924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:27.767306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:27.767727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:27.768488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:27.769099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:27.769530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:27.838784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:27.847296 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85155cce-baf8-46c1-a7bf-e64a70f15eb7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091726 Sep 19 12:19:27.847877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1304/2646] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:28.222226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:28.222822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:28.229137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:28.229608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:28.230064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:28.230745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:28.231192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:28.231609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:28.363784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:28.373171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:28.374642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:28.375804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23a990a6-28e9-41d6-a7b9-3883cc0d85af tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.157510 Sep 19 12:19:28.376365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1343/2647] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:28 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:28.871201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:28.871837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:28.878273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:28.878738 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:28.879164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:28.879843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:28.880290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:28.880705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:28.942254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:28.951523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7cfd2b35-69bd-4cce-aa6b-3578032dae54 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083835 Sep 19 12:19:28.952095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1305/2648] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:29.400580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:29.401118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:29.407711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:29.408192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:29.408619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:29.409303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:29.409747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:29.410194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:29.543514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:29.553074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:29.554560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:29.555820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b868b2bc-0912-40eb-8a32-413656b81271 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159132 Sep 19 12:19:29.556379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1344/2649] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:29 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:29.975285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:29.975891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:29.983081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:29.983561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:29.983993 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:29.984684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:29.985135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:29.985565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:30.048136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:30.057099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b6fb7ff-91a9-43f8-9158-3ac11334d6fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085349 Sep 19 12:19:30.057699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1306/2650] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:30.582279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:30.582894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:30.589963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:30.590449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:30.590885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:30.592133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:30.592587 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:30.593014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:30.722837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:30.731481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:30.733096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:30.734296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-427bbc65-47b7-4956-b7ba-65309fc1a2f5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.155990 Sep 19 12:19:30.734853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1345/2651] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:30 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:31.081685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:31.082317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:31.089727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:31.090234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:31.090667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:31.092107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:31.092558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:31.092981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:31.157862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:31.166221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9668a285-17e9-4a40-aca1-95d48861b866 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088402 Sep 19 12:19:31.166792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1307/2652] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:31.759866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:31.760530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:31.763042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:31.768599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:31.769086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:31.769520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:31.770239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:31.770720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:31.771141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:31.903406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:31.912509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:31.913991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:31.915149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32704ff2-660c-4d0d-94dd-f06c238ee0c7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.159252 Sep 19 12:19:31.915697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1346/2653] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:31 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:32.188644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:32.189253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:32.191277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:19:32.191426 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:19:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:19:32.197639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:32.198230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:32.198678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:32.199383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:32.199835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:32.200261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:32.264167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:32.272594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c4e9bc9-ba3e-4750-8d10-02cbb66d53b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087960 Sep 19 12:19:32.273168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1308/2654] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:32.942205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:32.942814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:32.949706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:32.950215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:32.951323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:32.952016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:32.952843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:32.953270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:33.084251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:33.093756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:33.095225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:33.096390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04b2f5bc-4106-4e41-898d-9f14d7c3c5f0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.158117 Sep 19 12:19:33.096948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1347/2655] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:32 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:33.296943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:33.297538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:33.303967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:33.304449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:33.304884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:33.305578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:33.306055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:33.306479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:33.368716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:33.377032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-93cf1c8f-d23c-4e14-967b-c1cb7920cec4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084464 Sep 19 12:19:33.377598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1309/2656] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:34.124490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:34.125086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:34.131798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:34.132321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:34.132784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:34.133480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:34.134010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:34.134426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:34.283513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:34.292561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:34.294034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:34.295186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9150532e-a517-40d5-9cbf-543b1c1d54ae tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.176548 Sep 19 12:19:34.295743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1348/2657] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:34 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:34.401014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:34.401672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:34.408250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:34.408737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:34.409171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:34.409887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:34.410341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:34.410760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:34.479273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:34.489113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71fb05a8-7a5a-49df-a99c-dc0256326a98 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.092226 Sep 19 12:19:34.489701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1310/2658] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:35.321252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:35.321936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:35.329178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:35.329663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:35.330187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:35.330884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:35.331338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:35.331778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:35.468652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:35.472317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:35.478452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:35.479947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:35.481172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06ee067b-feb1-4158-8112-0a1c4ea8eed1 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.163834 Sep 19 12:19:35.481908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1349/2659] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:35 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:35.512454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:35.513557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:35.519997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:35.520482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:35.520917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:35.521603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:35.522089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:35.522516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:35.585519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:35.597343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45675596-79a6-4b2c-8196-b28edccaee27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088672 Sep 19 12:19:35.598054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1311/2660] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:36.507973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:36.508751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:36.517061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:36.517543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:36.518012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:36.518713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:36.519167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:36.519593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:36.626070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:36.626685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:36.632771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:36.633264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:36.633701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:36.634471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:36.634935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:36.635389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:36.654105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:36.662742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:36.664169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:36.665332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ddd02c5c-8893-4b43-b05c-7d982e879ebc tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.161682 Sep 19 12:19:36.665979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1350/2661] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:36 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:36.702773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:36.711101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca0afe81-6c24-4709-9077-4570f1f6fb9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090094 Sep 19 12:19:36.711665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1312/2662] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:19:37.692620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:37.693242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:37.699941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:37.700433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:37.700873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:37.701579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:37.702055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:37.702472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:37.734943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:37.735648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:37.742525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:37.743016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:37.743452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:37.744161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:37.744617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:37.745047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:37.831387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:37.840042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b47ee42e-810b-4f9b-84c8-7d7f38d39b50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.109533 Sep 19 12:19:37.840619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1313/2663] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:37.872418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:37.881594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:37.883085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:37.884267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a3763ec-7ab6-48c5-be13-d4afed5c4421 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.195606 Sep 19 12:19:37.884825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1351/2664] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:37 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:38.864826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:38.865435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:38.872040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:38.872822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:38.873263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:38.874000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:38.874449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:38.874869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:38.911889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:38.912547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:38.920760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:38.921526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:38.922157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:38.923071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:38.923768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:38.924356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:38.947419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:38.958861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e0ca09f2-d6a3-4734-92ac-38bf61c756a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.097757 Sep 19 12:19:38.959602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1314/2665] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:39.069001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:39.082520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:39.084211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:39.085414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76d46079-ab77-4724-8f88-949acf4734b0 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.178294 Sep 19 12:19:39.086017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1352/2666] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:38 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:19:39.986857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:39.987466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:39.994414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:39.995191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:39.995764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:39.996780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:39.998088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:39.998689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:40.016196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:40.081128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:40.093504 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b018dcb5-f1f3-452b-9d45-120ba4878b45 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.110508 Sep 19 12:19:40.094117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1315/2667] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:19:40.117249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:40.117983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:40.125272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:40.125912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:40.126354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:40.127132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:40.127605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:40.128024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:40.288352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:40.300196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:40.301663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:40.302894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b56941c-458a-40e3-ae06-7157ff9bb241 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.189676 Sep 19 12:19:40.303460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1353/2668] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:40 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:19:41.119391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:41.120058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:41.127418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:41.127904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:41.128341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:41.129083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:41.129561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:41.130015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:41.196387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:41.205806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79ecf75d-e623-4008-b787-ea0d40282278 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090466 Sep 19 12:19:41.206395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1316/2669] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:41.330451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:41.331269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:41.338205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:41.338819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:41.339256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:41.339954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:41.340402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:41.340876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:41.493516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:41.511333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:41.513950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:41.515910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-07878c67-e46c-4936-bbf6-20eb797715a3 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.189707 Sep 19 12:19:41.516773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1354/2670] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:41 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:42.237914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:42.238533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:42.245785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:42.246343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:42.246777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:42.247529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:42.248019 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:42.248478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:42.316580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:42.326461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-efe34e7b-0a18-4ce8-aa75-fe821ade0962 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.092278 Sep 19 12:19:42.327144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1317/2671] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:42.554451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:42.555094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:42.562853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:42.563682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:42.564240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:42.565049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:42.565538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:42.566049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:42.707163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:42.716570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:42.718201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:42.719322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcf72a61-5397-4c51-9611-f6548a8741b9 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 200 len: 1800 microversion: 2.20 time: 0.169106 Sep 19 12:19:42.719883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1355/2672] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:42 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:42.746237 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6f180111-d865-4989-8fb8-35fe202b7be6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '.version_select at 0x7f4ff6ea4ee0>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:42.770763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6f180111-d865-4989-8fb8-35fe202b7be6 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994989413" status: 204 len: 0 microversion: 2.20 time: 0.028747 Sep 19 12:19:42.771341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1318/2673] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Sep 19 12:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994989413 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:19:43.351636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:43.352257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:43.358623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:43.359108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:43.359578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:43.360240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:43.360686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:43.361107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:43.452878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:43.461731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c22f656-5032-4b08-89c7-20fb4cd051a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.114098 Sep 19 12:19:43.462336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1356/2674] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:44.272097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-b810b3f7-5f5f-4210-9432-18d204ceb143 req-9e29a2f3-3bfb-42b4-9516-49b30795b361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:44.272711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f000e43a-4938-405d-bec0-6e0d03220a26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'create', calling method: .version_select at 0x7f4ff6469e50>, body: {"keypair": {"name": "tempest-keypair-1057299352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtN26nK/UMNYZcPYz1GXHt11qfhZ76GVK6X1X0e04QObzckHuhfyFD8OPizhAfGwt1WdYox0IBn18Y1Vm0ey1I8A8GFGNz7Y1Wrv8h68jnCsDEZEd8wuz8sXUE1IhuVNA=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:44.286807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b810b3f7-5f5f-4210-9432-18d204ceb143 req-9e29a2f3-3bfb-42b4-9516-49b30795b361 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:44.287631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b810b3f7-5f5f-4210-9432-18d204ceb143 req-9e29a2f3-3bfb-42b4-9516-49b30795b361 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:44.288291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b810b3f7-5f5f-4210-9432-18d204ceb143 req-9e29a2f3-3bfb-42b4-9516-49b30795b361 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:44.292457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-f000e43a-4938-405d-bec0-6e0d03220a26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for project 256ccce56c534cacb247aa128399f3f1. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:19:44.299575 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-f000e43a-4938-405d-bec0-6e0d03220a26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for user 766511b86ad643c099998fc4e1638f9a and project 256ccce56c534cacb247aa128399f3f1. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:19:44.301984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-b810b3f7-5f5f-4210-9432-18d204ceb143 req-9e29a2f3-3bfb-42b4-9516-49b30795b361 service nova] Creating event network-changed:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 12:19:44.308224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-b810b3f7-5f5f-4210-9432-18d204ceb143 req-9e29a2f3-3bfb-42b4-9516-49b30795b361 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324129 Sep 19 12:19:44.309193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1319/2675] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:44.334900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f000e43a-4938-405d-bec0-6e0d03220a26 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.066348 Sep 19 12:19:44.341816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1357/2676] 10.222.0.88 () {62 vars in 1200 bytes} [Mon Sep 19 12:19:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 19 12:19:44.503138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:44.504861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:44.518975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:44.520708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:44.522511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:44.524428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:44.525542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:44.526985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:44.649161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:44.660599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-badae989-b474-4389-8676-e6387811d696 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.167043 Sep 19 12:19:44.661388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1320/2677] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:45.692680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:45.693884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:45.704050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:45.704540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:45.704970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:45.705727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:45.706510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:45.706989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:45.779243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:45.787591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6336fa2a-39ea-47bb-a9d6-b03b7d2321e7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.099205 Sep 19 12:19:45.788162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1358/2678] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:46.061647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-261195297", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1cff81ad-d456-41a4-b3b7-0f85405c64ec"}], "security_groups": [{"name": "tempest-securitygroup--1903705792"}], "key_name": "tempest-keypair-1057299352", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:46.186985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] validate_networks() for [('1cff81ad-d456-41a4-b3b7-0f85405c64ec', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:19:46.719944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:19:46.720369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:19:46.720879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:19:46.721288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:19:46.721752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:19:46.730893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:46.731567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:46.732008 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:46.732737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:46.733191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:46.733616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:46.751263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for project 256ccce56c534cacb247aa128399f3f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:19:46.755789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Getting quotas for user 766511b86ad643c099998fc4e1638f9a and project 256ccce56c534cacb247aa128399f3f1. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:19:46.769666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:19:46.772403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:19:46.815069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:46.816006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:46.823981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:46.824747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:46.826007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:46.827083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94adf729-ec39-47cc-af50-1565ec4308f7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.770243 Sep 19 12:19:46.827227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:46.827919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1321/2679] 10.222.0.88 () {62 vars in 1188 bytes} [Mon Sep 19 12:19:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 12:19:46.828080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:46.828398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:46.840457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1a4755c9-b404-4cd2-b712-600e378b36bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:46.842339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1a4755c9-b404-4cd2-b712-600e378b36bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:46.905192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a4755c9-b404-4cd2-b712-600e378b36bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:46.913319 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a4755c9-b404-4cd2-b712-600e378b36bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:46.914895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1a4755c9-b404-4cd2-b712-600e378b36bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:46.916027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1a4755c9-b404-4cd2-b712-600e378b36bb tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1281 microversion: 2.20 time: 0.080919 Sep 19 12:19:46.916586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1322/2680] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:46 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:19:46.934769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:46.943523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-042b8bde-5914-49e4-a6bd-5f9aee760db9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.135353 Sep 19 12:19:46.944166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1359/2681] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:47.946121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:47.946730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:47.954157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:47.954644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:47.955075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:47.955768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:47.956269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:47.956929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:47.973618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:47.974849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:47.984733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:47.985561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:47.986436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:47.987589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:47.988333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:47.989036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:48.048056 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:48.064132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:48.066338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:48.067948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f75511b-2294-457f-b2f5-c66a46f513d7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1333 microversion: 2.20 time: 0.125658 Sep 19 12:19:48.068691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1323/2682] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:47 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1333 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:48.082190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:48.097154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ecdc6f2-7bc3-4884-a430-fe13e3ca4be1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.132090 Sep 19 12:19:48.097875 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1360/2683] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:19:49.095509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:49.096113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:49.103889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:49.104383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:49.104821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:49.105671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:49.106827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:49.107590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:49.130080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:49.132815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:49.153825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:49.157388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:49.162952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:49.164191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:49.164898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:49.165569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:49.271089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:49.282448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eeee6ec3-6225-40d3-8a21-186eb350e69e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.163549 Sep 19 12:19:49.284053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1361/2684] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:49.294878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:49.303345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:49.305013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:49.306380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-85bc1483-c0ee-4f32-a208-5597af7f2be4 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1407 microversion: 2.20 time: 0.214771 Sep 19 12:19:49.322927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1324/2685] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:49 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:49.732832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-3b941061-752a-4c8d-a738-9b610bd37aa3 req-e5223ebe-3202-45d7-9539-b33eb8886404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0801a648-e9e7-4bb2-bbb7-089d67aea513", "tag": "bab6b572-93d2-47d2-afd3-38ffa91a825a"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:49.743553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3b941061-752a-4c8d-a738-9b610bd37aa3 req-e5223ebe-3202-45d7-9539-b33eb8886404 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:49.743967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3b941061-752a-4c8d-a738-9b610bd37aa3 req-e5223ebe-3202-45d7-9539-b33eb8886404 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:49.744302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3b941061-752a-4c8d-a738-9b610bd37aa3 req-e5223ebe-3202-45d7-9539-b33eb8886404 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:49.756911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-3b941061-752a-4c8d-a738-9b610bd37aa3 req-e5223ebe-3202-45d7-9539-b33eb8886404 service nova] Creating event network-changed:bab6b572-93d2-47d2-afd3-38ffa91a825a for instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 on hv-cinder-85829 Sep 19 12:19:49.761755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-3b941061-752a-4c8d-a738-9b610bd37aa3 req-e5223ebe-3202-45d7-9539-b33eb8886404 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032867 Sep 19 12:19:49.762911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1362/2686] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:50.306707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:50.307348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:50.314512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:50.314991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:50.315429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:50.316152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:50.316606 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:50.317022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:50.332247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:50.332933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:50.339802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:50.340314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:50.340789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:50.341497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:50.341989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:50.342419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:50.387668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:50.396159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8c485458-352d-4568-9220-e0386a7e932e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.093240 Sep 19 12:19:50.396746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1325/2687] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:50.483458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:50.491876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:50.493356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:50.494501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb569201-a05f-437b-a459-869623b5990e tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1407 microversion: 2.20 time: 0.167008 Sep 19 12:19:50.495064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1363/2688] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:50 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:19:51.419385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:51.420001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:51.426949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:51.427434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:51.427866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:51.428765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:51.429087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:51.429436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:51.496306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:51.505218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4cb4d298-ac95-4a54-bebb-694a6a76aea6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089776 Sep 19 12:19:51.505803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1326/2689] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:51.520085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:51.520692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:51.527105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:51.527581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:51.528087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:51.528773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:51.529218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:51.529634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:51.663013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:51.671278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:51.672798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:51.673969 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acb0e8a1-8505-4ee6-aefa-668456c2fe32 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1407 microversion: 2.20 time: 0.157708 Sep 19 12:19:51.674523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1364/2690] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:51 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:52.530096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:52.530705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:52.537388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:52.538016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:52.538343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:52.539038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:52.539494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:52.539917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:52.609649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:52.618118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e3445066-9a49-4c3a-82b5-f09d740ceccd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091961 Sep 19 12:19:52.618698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1327/2691] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:52.699773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:52.700406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:52.707091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:52.707579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:52.708010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:52.708745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:52.709193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:52.709609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:52.847189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:52.855227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:52.857331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:52.858448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99ef2541-c996-4579-93c3-e4c556dcfc36 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1407 microversion: 2.20 time: 0.162951 Sep 19 12:19:52.859005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1365/2692] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:52 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:53.642495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:53.643101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:53.649991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:53.650489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:53.650942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:53.651636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:53.652089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:53.652515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:53.718895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:53.727264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3871e20c-50f3-47e5-aecb-e5fccc0b3f08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088742 Sep 19 12:19:53.727846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1328/2693] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:53.883626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:53.884261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:53.891724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:53.892207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:53.892682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:53.893315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:53.893757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:53.894204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:54.029570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:54.038507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:54.039948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:54.041221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6de7066-8334-4fbd-ae59-9c94c9da6d72 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1407 microversion: 2.20 time: 0.161684 Sep 19 12:19:54.041785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1366/2694] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:53 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:54.750733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:54.751674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:54.758254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:54.758789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:54.759235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:54.759941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:54.760395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:54.760823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:54.829947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:54.838788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5ad5387c-5d90-4f39-b9eb-7f1b57db5a34 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.092175 Sep 19 12:19:54.839672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1329/2695] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:55.066993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:55.067635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:55.069808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:55.076702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:55.077189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:55.077618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:55.078362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:55.078810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:55.079241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:55.209207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-4b3c4b44-05cf-4851-99bf-e93fce455901 req-f239da8a-648e-40d3-9f86-22b5f6cc83cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0801a648-e9e7-4bb2-bbb7-089d67aea513", "name": "network-vif-plugged", "status": "completed", "tag": "bab6b572-93d2-47d2-afd3-38ffa91a825a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:55.221529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-4b3c4b44-05cf-4851-99bf-e93fce455901 req-f239da8a-648e-40d3-9f86-22b5f6cc83cb service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:55.222034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-4b3c4b44-05cf-4851-99bf-e93fce455901 req-f239da8a-648e-40d3-9f86-22b5f6cc83cb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:55.222465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-4b3c4b44-05cf-4851-99bf-e93fce455901 req-f239da8a-648e-40d3-9f86-22b5f6cc83cb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:55.235635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-4b3c4b44-05cf-4851-99bf-e93fce455901 req-f239da8a-648e-40d3-9f86-22b5f6cc83cb service nova] Creating event network-vif-plugged:bab6b572-93d2-47d2-afd3-38ffa91a825a for instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 on hv-cinder-85829 Sep 19 12:19:55.241004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-4b3c4b44-05cf-4851-99bf-e93fce455901 req-f239da8a-648e-40d3-9f86-22b5f6cc83cb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134207 Sep 19 12:19:55.241614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1330/2696] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:19:55.250603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:55.259954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:55.261742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:55.263311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec8d3001-b9df-4534-95a9-88549164b777 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1407 microversion: 2.20 time: 0.200420 Sep 19 12:19:55.264268 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1367/2697] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:55 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:55.868308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:55.869653 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:55.877091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:55.877580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:55.878026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:55.878730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:55.879181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:55.880014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:55.949096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:55.958173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aaa5db7f-dc03-4d37-a801-53c6cc9e85a5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.097713 Sep 19 12:19:55.958748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1331/2698] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:56.291065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:56.291869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:56.299927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:56.300421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:56.300878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:56.301824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:56.302279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:56.302706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:56.307078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:56.454283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:56.465331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:56.467948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:56.470160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d077371f-55d5-4b59-a5b8-f61016c0fc37 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1407 microversion: 2.20 time: 0.182550 Sep 19 12:19:56.471313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1368/2699] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:56 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:56.984459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:56.985070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:56.987052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:56.988194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=8 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:56.988933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:19:56.997272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:56.997808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:56.998222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:56.998999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:56.999558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:57.000203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:57.078383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:57.089416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cf975c81-bbbc-4dd8-b142-6add298cc1b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.109689 Sep 19 12:19:57.090043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1332/2700] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:57.496863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:57.497724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:57.504298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:57.504787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:57.505222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:57.505949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:57.506400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:57.506823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:57.642660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:57.650805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:57.652249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:57.654089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df427142-5567-4494-8d1a-45460090bbc7 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1600 microversion: 2.20 time: 0.161458 Sep 19 12:19:57.654655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1369/2701] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:19:57 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:19:57.679275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:57.679778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:57.686012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:57.686375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:57.686813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:57.687523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:57.687983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:57.688413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:57.770466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-520e7281-3b56-414c-a904-3dc0163eb45d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095065 Sep 19 12:19:57.771058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1333/2702] 10.222.0.88 () {60 vars in 1316 bytes} [Mon Sep 19 12:19:57 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:19:58.114730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:58.115353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:58.122166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:58.122652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:58.123078 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:58.123766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:58.124208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:58.124621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:58.193922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:58.202826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-242bea68-ed38-48d0-93b9-9fdc198a4644 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091974 Sep 19 12:19:58.203636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1370/2703] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:19:58.738249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-47fc20d5-945a-4351-9dd5-78f36bd66905 req-c5c8606a-cbe7-4112-ad51-db823cc5e9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0801a648-e9e7-4bb2-bbb7-089d67aea513", "tag": "bab6b572-93d2-47d2-afd3-38ffa91a825a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:19:58.748156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47fc20d5-945a-4351-9dd5-78f36bd66905 req-c5c8606a-cbe7-4112-ad51-db823cc5e9fb service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:58.748643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47fc20d5-945a-4351-9dd5-78f36bd66905 req-c5c8606a-cbe7-4112-ad51-db823cc5e9fb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:58.749071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-47fc20d5-945a-4351-9dd5-78f36bd66905 req-c5c8606a-cbe7-4112-ad51-db823cc5e9fb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:58.760643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-47fc20d5-945a-4351-9dd5-78f36bd66905 req-c5c8606a-cbe7-4112-ad51-db823cc5e9fb service nova] Creating event network-changed:bab6b572-93d2-47d2-afd3-38ffa91a825a for instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 on hv-cinder-85829 Sep 19 12:19:58.765863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-47fc20d5-945a-4351-9dd5-78f36bd66905 req-c5c8606a-cbe7-4112-ad51-db823cc5e9fb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031759 Sep 19 12:19:58.766468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1334/2704] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:19:59.227292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:19:59.227965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:19:59.235646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:59.236442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:59.236878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:59.237582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:19:59.238062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:19:59.238486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:19:59.316640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:19:59.341075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2138ccad-dcec-483f-95d8-036ac8b7974d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.117194 Sep 19 12:19:59.342660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1371/2705] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:19:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:00.367542 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:00.368251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:00.375015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:00.375498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:00.375936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:00.376692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:00.377149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:00.377576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:00.440951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:00.449551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f6b4aac1-9e41-4d8f-999a-173464c6b36c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087438 Sep 19 12:20:00.450156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1335/2706] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:01.474790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:01.475354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:01.481715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:01.482226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:01.482656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:01.483342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:01.483791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:01.484208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:01.545229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:01.553477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20c0583b-78a9-400a-bc21-f12267d5f822 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082664 Sep 19 12:20:01.554126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1372/2707] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:02.579532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:02.580511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:02.588218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:02.588742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:02.589189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:02.590430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:02.590891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:02.591321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:02.653947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:02.662345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ca3df3bf-2a46-4176-b6a1-7e9e7f7cbc16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088828 Sep 19 12:20:02.662920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1336/2708] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:03.690108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:03.690701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:03.693121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:03.698438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:03.698915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:03.699417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:03.700102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:03.700547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:03.700962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:03.765675 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:03.774043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-718bcf4c-0e12-4722-998d-14521abf5fd3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087825 Sep 19 12:20:03.774607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1373/2709] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:04.797755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:04.798410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:04.805253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:04.805755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:04.806226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:04.807061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:04.807539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:04.807956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:04.811124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=100 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:04.874938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:04.883546 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-77177728-6276-4b68-84ff-1d6688bd48fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090236 Sep 19 12:20:04.884141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1337/2710] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:05.906792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:05.907432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:05.914293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:05.914782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:05.915217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:05.915912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:05.916366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:05.916816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:05.979108 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:05.987719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9141e82-27b1-483d-b7b8-e95510236ff4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084816 Sep 19 12:20:05.988274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1374/2711] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:07.011764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:07.012449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:07.019051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:07.019541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:07.019981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:07.020690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:07.021150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:07.021583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:07.094033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:07.106725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-69a0dfa7-f46c-4f79-8da2-c5f8702d9875 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.096944 Sep 19 12:20:07.106725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1338/2712] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:08.130288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:08.130877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:08.137065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:08.137550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:08.138037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:08.138717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:08.139162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:08.139583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:08.204658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:08.215782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9068d7c-5ea5-43c7-890b-fe0a7c7e075f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089240 Sep 19 12:20:08.216793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1375/2713] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:09.240053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:09.240677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:09.247808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:09.248294 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:09.248732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:09.249431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:09.249920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:09.250465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:09.314596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:09.323330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-164e4826-5766-4bd9-b224-f78a86495755 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086924 Sep 19 12:20:09.323950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1339/2714] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:10.348339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:10.348954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:10.355571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:10.356065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:10.356500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:10.357199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:10.357649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:10.358102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:10.429887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:10.439122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1535dca2-1573-45ae-ad45-8cc445ca04b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.095201 Sep 19 12:20:10.439696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1376/2715] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:11.463508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:11.464118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:11.471222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:11.471712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:11.472150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:11.472974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:11.473439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:11.473904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:11.544014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:11.553337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-24bb6b92-14af-4706-9955-7a8d5b930aeb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.094116 Sep 19 12:20:11.554076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1340/2716] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:12.578194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:12.578794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:12.585340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:12.585886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:12.586320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:12.587016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:12.587467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:12.588138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:12.654230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:12.662601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-977d03a3-f058-4965-b280-d7cbc8fc4fb4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088772 Sep 19 12:20:12.663176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1377/2717] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:13.686395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:13.687077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:13.693554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:13.694081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:13.694822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:13.695531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:13.695982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:13.696407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:13.762571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:13.771134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-39fb8ca4-c3ca-4593-8581-e1b989a0f092 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089099 Sep 19 12:20:13.771726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1341/2718] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:14.794847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:14.795446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:14.802456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:14.802940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:14.803371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:14.804065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:14.804514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:14.804945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:14.869754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:14.880639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83ea46bf-c314-428d-bd49-2fc30a748fe4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089986 Sep 19 12:20:14.881230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1378/2719] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:15.905288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:15.905888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:15.912616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:15.913098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:15.913527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:15.914245 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:15.914696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:15.915120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:15.977708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:15.986797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff2b6396-cb9d-40fd-9acc-6d8e4943f67d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086044 Sep 19 12:20:15.987373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1342/2720] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:17.011727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:17.012313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:17.018836 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:17.019359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:17.019735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:17.020441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:17.020888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:17.021302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:17.087777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:17.096457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4d77189-98c7-4336-bc14-f5ae9bf5afc3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090274 Sep 19 12:20:17.097023 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1379/2721] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:18.120455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:18.121087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:18.127629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:18.128107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:18.128537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:18.129227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:18.129670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:18.130118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:18.191447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:18.199725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-48fa3b64-574b-4e63-bb2f-7385b84b7550 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083086 Sep 19 12:20:18.200295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1343/2722] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:19.223960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:19.224625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:19.231868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:19.232361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:19.232795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:19.233527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:19.234012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:19.234439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:19.299578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:19.308920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bc537cd-1fb5-453c-a55b-4605dae6d016 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088249 Sep 19 12:20:19.309517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1380/2723] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:20.332200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:20.332812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:20.340014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:20.340488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:20.340913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:20.341596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:20.342063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:20.342478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:20.403623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:20.411985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3be5e7fd-c8ec-47dc-9acc-9ea64a565c8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083723 Sep 19 12:20:20.412550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1344/2724] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:21.438214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:21.438914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:21.446320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:21.446821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:21.447255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:21.448077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:21.448454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:21.449096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:21.516016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:21.524330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bbb3d14-8a73-4212-853c-dc4e0bfba8b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090822 Sep 19 12:20:21.524896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1381/2725] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:22.546968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:22.547598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:22.554387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:22.554880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:22.555320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:22.556027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:22.556484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:22.556913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:22.847469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:22.855832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-399af698-0ad9-44a2-9943-3e8c99a74867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.312849 Sep 19 12:20:22.856397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1345/2726] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:23.879500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:23.880063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:23.887011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:23.887518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:23.887975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:23.888694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:23.889146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:23.889573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:23.953199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:23.962072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f716765-e215-488e-8f07-9ffd48931196 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086567 Sep 19 12:20:23.962661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1382/2727] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:24.987613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:24.988302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:24.994700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:24.995184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:24.995644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:24.996340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:24.996798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:24.997221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:25.064615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:25.073601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f611e61b-dd7c-493e-b05d-6c2d42a44d9d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090410 Sep 19 12:20:25.074214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1346/2728] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:26.097495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:26.098355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:26.105344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:26.105863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:26.106295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:26.106993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:26.107446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:26.107861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:26.172515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:26.180737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e0ede35-2a4b-4321-bef1-f555e74fd499 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087130 Sep 19 12:20:26.181293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1383/2729] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:27.204508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:27.205099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:27.207452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=30 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:27.212828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:27.213577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:27.214581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:27.215328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:27.215787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:27.216217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:27.280413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:27.288743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51f1b687-5f37-498f-8d73-feb1c3bf4177 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088186 Sep 19 12:20:27.289311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1347/2730] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:28.313155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:28.313829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:28.320367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:28.320873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:28.321277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:28.321994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:28.322446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:28.322867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:28.325494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=95 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:28.387764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:28.396190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d306328a-e438-4aac-9e5f-37d4c3837e1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086970 Sep 19 12:20:28.396764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1384/2731] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:29.420013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:29.420579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:29.426819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:29.427306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:29.427748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:29.428440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:29.428900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:29.429329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:29.490322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:29.498696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-47ebd4c0-2a56-423d-8a95-53ccba22131f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083212 Sep 19 12:20:29.499534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1348/2732] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:30.522897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:30.523647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:30.531105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:30.531593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:30.532032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:30.532729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:30.533251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:30.533684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:30.596531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:30.604957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-134447e4-129c-491d-9ef6-2dcc1ff63ecf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086320 Sep 19 12:20:30.605521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1385/2733] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:31.627381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:31.627994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:31.634980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:31.635464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:31.635929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:31.636624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:31.637077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:31.637500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:31.703079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:31.711262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-64c8d851-f4f7-4c01-b34c-b6af2015148b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087830 Sep 19 12:20:31.711825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1349/2734] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:32.736115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:32.736726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:32.743462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:32.743943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:32.744375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:32.745683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:32.746167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:32.746590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:32.810491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:32.819054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d245709e-c5df-465d-984b-9bc4a6cab9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086734 Sep 19 12:20:32.819858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1386/2735] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:33.612497 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:33.613021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:33.619474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:33.619955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:33.620387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:33.621103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:33.621553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:33.622006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:33.645414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0aa809e5-dfef-470b-b4bb-096c1aab98dd tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513/ips" status: 200 len: 152 microversion: 2.20 time: 0.036864 Sep 19 12:20:33.646009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1350/2736] 10.222.0.88 () {60 vars in 1289 bytes} [Mon Sep 19 12:20:33 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:20:33.843044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:33.843619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:33.845921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:33.851355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:33.851844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:33.852281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:33.852989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:33.853442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:33.853892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:33.916013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:33.924027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b633216f-5065-48f3-badc-49e3906923c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085089 Sep 19 12:20:33.924595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1387/2737] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:34.947916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:34.949002 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:34.955349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:34.955819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:34.956259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:34.956961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:34.957412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:34.957864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:34.963368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=82 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:35.020652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:35.029776 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2119b8c0-774b-47a0-a5ef-cf01c4f00633 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085764 Sep 19 12:20:35.030340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1351/2738] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:36.052845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:36.053454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:36.061065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:36.061526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:36.061986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:36.062683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:36.063132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:36.063551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:36.128706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:36.137701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14b9851f-eb79-4d20-a567-d4642e398b5a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088712 Sep 19 12:20:36.138293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1388/2739] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:37.161474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:37.162310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:37.169230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:37.169715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:37.170181 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:37.170880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:37.171336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:37.171761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:37.233452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:37.243257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0b2d5c9f-7738-49d0-be19-1bafb48b69b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085196 Sep 19 12:20:37.244263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1352/2740] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:38.268530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:38.269141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:38.275124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:38.275614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:38.276046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:38.277404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:38.277884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:38.278306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:38.343165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:38.351239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b79630c7-ffe3-44d5-bcf9-cb30673709c2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086873 Sep 19 12:20:38.351790 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1389/2741] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:39.374938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:39.375668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:39.382090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:39.382575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:39.383010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:39.383699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:39.384153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:39.384575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:39.447018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:39.455329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7fd93788-b774-4f92-8f59-76600a281beb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084262 Sep 19 12:20:39.455900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1353/2742] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:40.478683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:40.479280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:40.485573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:40.486087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:40.486521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:40.487200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:40.487645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:40.488095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:40.554511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:40.563326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62d8ab9e-cd78-4119-ba8f-51397e169e23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088551 Sep 19 12:20:40.563889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1390/2743] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:41.586522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:41.587137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:41.593973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:41.594462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:41.594901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:41.595594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:41.596050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:41.596475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:41.657424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:41.665669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3782a7da-4e41-4de5-8ed4-32d2de094296 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082956 Sep 19 12:20:41.666194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1354/2744] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:42.688536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:42.689157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:42.695513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:42.695992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:42.696418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:42.697117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:42.697563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:42.698535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:42.759282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:42.767905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49ba20e1-a135-48ee-a711-d5aee2a1914b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083357 Sep 19 12:20:42.768469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1391/2745] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:43.793446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:43.794107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:43.800576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:43.801064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:43.801511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:43.802249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:43.802728 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:43.804491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:43.866141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:43.874302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-134ba368-fac0-45a3-9663-4a51df6640fb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085859 Sep 19 12:20:43.874873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1355/2746] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:44.898442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:44.899066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:44.905597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:44.906102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:44.906531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:44.907209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:44.907650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:44.908063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:44.972383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:44.981035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba9b0570-5c52-4cd4-9635-cf36e724446b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086498 Sep 19 12:20:44.981591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1392/2747] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:46.004567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:46.005164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:46.012165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:46.012646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:46.013087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:46.013793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:46.014258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:46.014685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:46.084628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:46.093028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3634982d-c8c1-405b-8c3e-5d86c1188d50 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.092444 Sep 19 12:20:46.093603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1356/2748] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:47.116483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:47.117083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:47.123418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:47.123898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:47.124330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:47.125009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:47.125483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:47.125963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:47.187039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:47.195060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37ef4a27-ae67-4dd6-8b31-1d4a0974e5cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082489 Sep 19 12:20:47.195614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1393/2749] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:48.219310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:48.219900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:48.226315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:48.226794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:48.227222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:48.227903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:48.228350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:48.228819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:48.288797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:48.297065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a27a481c-e6eb-42df-8df9-3d679f805eab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.081634 Sep 19 12:20:48.297806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1357/2750] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:49.320399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:49.321005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:49.328163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:49.328646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:49.329080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:49.329794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:49.330247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:49.330671 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:49.394776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:49.403796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-639eb295-b9c2-4615-8f55-c2f75a6aa867 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087279 Sep 19 12:20:49.404297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1394/2751] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:50.427177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:50.427756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:50.434874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:50.435505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:50.435988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:50.436683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:50.437142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:50.437572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:50.497662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:50.505824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f2301c44-6f82-4b8a-9362-e8edaba0bb16 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082682 Sep 19 12:20:50.506400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1358/2752] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:51.530513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:51.531178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:51.537828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:51.538326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:51.538761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:51.539469 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:51.539927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:51.540350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:51.604100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:51.612596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad2b82a8-a191-4a13-bb71-f8cbccd7e981 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086661 Sep 19 12:20:51.613184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1395/2753] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:52.636481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:52.637152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:52.644010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:52.644535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:52.644972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:52.645683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:52.646168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:52.646591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:52.712658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:52.721641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0668aa09-d766-44c7-a36b-8e3e0a96d664 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089233 Sep 19 12:20:52.722239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1359/2754] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:53.746472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:53.747837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:53.754228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:53.754736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:53.755180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:53.755892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:53.756351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:53.756779 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:53.824447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:53.832910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cfeffc0a-a9f2-41f1-b6ea-f167f4fcef23 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091362 Sep 19 12:20:53.833495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1396/2755] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:54.856551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:54.857168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:54.863898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:54.864387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:54.864819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:54.865519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:54.866006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:54.866431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:54.929329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:54.940341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d8fabf1d-3cea-4471-862d-2c507cd2e7ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088088 Sep 19 12:20:54.941375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1360/2756] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:55.966012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:55.966580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:55.972981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:55.973463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:55.973949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:55.974723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:55.975240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:55.975673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:56.039791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:56.048600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34330331-a14d-44c1-8148-6f484210c22e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086879 Sep 19 12:20:56.049151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1397/2757] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:57.073277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:57.073907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:57.080633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:57.081121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:57.081559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:57.082303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:57.082754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:57.083179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:57.149075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:57.158318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6892c644-6289-443c-8bc8-790be46ed2df tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089398 Sep 19 12:20:57.158910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1361/2758] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:58.183013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:58.183716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:58.190475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:58.190959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:58.191388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:58.192077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:58.192520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:58.192942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:58.259549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:58.268200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-418e9127-658b-47bd-a487-929feaa745ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089820 Sep 19 12:20:58.268769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1398/2759] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:20:59.291492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:20:59.292101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:20:59.294453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=30 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:20:59.299779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:59.300261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:59.300690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:59.301383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:20:59.301857 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:20:59.302280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:20:59.367271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:20:59.376113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79d4e951-1d6d-4e26-936a-b5b9671d458e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088639 Sep 19 12:20:59.376682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1362/2760] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:20:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:00.400226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:00.400786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:00.407403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:00.407903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:00.408331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:00.409024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:00.409480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:00.409955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:00.412655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=90 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:00.474748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:00.483453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93ec3a4d-09bb-4e6d-b823-75037e69ed5d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087538 Sep 19 12:21:00.484019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1399/2761] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:01.507616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:01.508190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:01.515315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:01.515808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:01.516244 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:01.516940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:01.517423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:01.517881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:01.584192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:01.593383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-46eee195-4da1-4467-b08a-04c944c4308e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089680 Sep 19 12:21:01.593999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1363/2762] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:02.616664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:02.617285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:02.624142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:02.624623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:02.625058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:02.625749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:02.626221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:02.626644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:02.691573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:02.700270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b65ef48-12be-4a39-9b1d-d99a5ec60f2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087510 Sep 19 12:21:02.700829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1400/2763] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:03.724704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:03.725358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:03.731912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:03.732385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:03.732813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:03.733495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:03.733969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:03.734392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:03.797608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:03.805869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3673722a-431b-4202-aef0-5c4a18f1735b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085150 Sep 19 12:21:03.806953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1364/2764] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:04.831446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:04.832068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:04.834460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:04.840094 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:04.840577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:04.841011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:04.841706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:04.842181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:04.842602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:04.904404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:04.912868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a19bb9d-14ef-4444-a416-4d9fb761fe79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086927 Sep 19 12:21:04.913455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1401/2765] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:05.936193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:05.936781 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:05.944117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:05.944603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:05.945220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:05.945967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:05.946430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:05.947350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:05.950147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:06.010439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:06.018856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ce8762fa-3168-4d8d-99d2-d21c4439a638 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086740 Sep 19 12:21:06.019439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1365/2766] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:07.043549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:07.044690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:07.051273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:07.051805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:07.052265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:07.053056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:07.053511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:07.053965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:07.124763 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:07.133728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51c697a6-1e36-455f-aa1d-4f506c89e124 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.094936 Sep 19 12:21:07.134359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1402/2767] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:08.158336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:08.158963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:08.165696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:08.166254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:08.166696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:08.167444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:08.167900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:08.168328 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:08.233876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:08.242060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3b64734c-b93f-4649-8d7a-ff668743b29f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087568 Sep 19 12:21:08.242629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1366/2768] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:09.265634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:09.266266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:09.272656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:09.273133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:09.273562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:09.274277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:09.274724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:09.275834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:09.341110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:09.350087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ceaff220-8eb2-449f-9030-de8e46190237 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088053 Sep 19 12:21:09.350731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1403/2769] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:10.381200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:10.381853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:10.388272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:10.388748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:10.389179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:10.389887 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:10.390336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:10.390753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:10.452450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:10.461699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-555c37d6-0d7a-443f-a9b1-e1f8a1a6e874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084316 Sep 19 12:21:10.462342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1367/2770] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:11.485152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:11.485874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:11.488746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:21:11.489072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:21:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:21:11.496373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:11.496865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:11.497301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:11.498034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:11.498644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:11.499122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:11.567366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:11.576320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0e7a5de-5f9d-4cef-a04f-7f718b6c8d35 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.095170 Sep 19 12:21:11.577344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1404/2771] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:12.601162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:12.601746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:12.608968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:12.609425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:12.609894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:12.610578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:12.611026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:12.611446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:12.673256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:12.682164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-88310df2-f4a9-4191-984a-60d3388aa28e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084857 Sep 19 12:21:12.682726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1368/2772] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:13.704630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:13.705236 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:13.712739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:13.713490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:13.713971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:13.714690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:13.715149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:13.715579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:13.780480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:13.788794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca7dbf8b-cc7a-4b7a-911f-8de608f68ae6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088065 Sep 19 12:21:13.789357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1405/2773] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:14.812152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:14.812761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:14.819411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:14.819919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:14.820356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:14.821066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:14.822074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:14.822550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:14.889222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:14.897786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-646af6c0-8da5-4b6c-88fe-6a6d6d6a572d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089922 Sep 19 12:21:14.898372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1369/2774] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:15.923165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:15.923737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:15.930291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:15.930806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:15.931239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:15.931935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:15.932383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:15.932807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:15.997468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:16.005653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50fa837c-0753-41ae-96d7-8d472e399511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086450 Sep 19 12:21:16.006383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1406/2775] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:17.028531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:17.029125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:17.035619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:17.036036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:17.036465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:17.037146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:17.037593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:17.038208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:17.103408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:17.111523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0fdb5030-b8b1-4d1d-bae3-f510cedd9794 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086930 Sep 19 12:21:17.112090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1370/2776] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:18.134655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:18.135253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:18.141614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:18.142133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:18.142569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:18.143258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:18.143716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:18.144135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:18.205355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:18.213976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-613de581-868d-4698-a3d9-13ccbbe31a1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083841 Sep 19 12:21:18.214542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1407/2777] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:19.237925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:19.238588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:19.245526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:19.246033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:19.246474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:19.247165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:19.247623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:19.248051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:19.308047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:19.316140 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-20008828-886b-40c2-bcdf-5a204303850d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082184 Sep 19 12:21:19.316708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1371/2778] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:20.339243 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:20.339842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:20.346193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:20.346669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:20.347100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:20.347777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:20.348221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:20.348635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:20.411561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:20.419600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad649861-cb72-49cc-910d-3f4917da3bcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084518 Sep 19 12:21:20.420159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1408/2779] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:21.442847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:21.443406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:21.450277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:21.450754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:21.451186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:21.451866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:21.452314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:21.452733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:21.513116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:21.521204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8ac966b7-a0a2-416f-9b0c-4e06eef68123 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082356 Sep 19 12:21:21.521789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1372/2780] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:22.545120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:22.545723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:22.552508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:22.553002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:22.553432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:22.554165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:22.554614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:22.555034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:22.622076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:22.630726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f16af073-e816-418e-a713-a8bf6fa6ab46 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089438 Sep 19 12:21:22.631312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1409/2781] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:23.654693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:23.655302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:23.661779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:23.662325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:23.662773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:23.663459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:23.663913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:23.664336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:23.728075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:23.736271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-58cd9bb4-51cc-49c9-bcbf-cee8e6fa99fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085438 Sep 19 12:21:23.736833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1373/2782] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:24.759224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:24.759832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:24.766370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:24.766856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:24.767291 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:24.767976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:24.768429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:24.768850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:24.833500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:24.842478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a44eca9d-3ea6-48e5-aa5b-17771c31a33f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087219 Sep 19 12:21:24.843037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1410/2783] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:25.865281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:25.865860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:25.872493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:25.872981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:25.873417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:25.874144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:25.874599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:25.875026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:25.936471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:25.944687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1ff8a694-1b2e-4825-aab2-88e6f2dca9f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083421 Sep 19 12:21:25.945257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1374/2784] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:26.968662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:26.969301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:26.975708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:26.976189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:26.976619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:26.977862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:26.978317 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:26.978738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:27.040868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:27.049064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7498f1f2-6d03-4f27-b7f7-9ed8de3fddc8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084402 Sep 19 12:21:27.049621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1411/2785] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:21:28.073387 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:28.074048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:28.079988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:28.080471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:28.080907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:28.081603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:28.082084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:28.082506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:28.144895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:28.154382 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff0aa1d6-0c86-491f-a0f1-aa7253839bc7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085565 Sep 19 12:21:28.155152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1375/2786] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:29.178343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:29.178956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:29.185350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:29.185866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:29.186303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:29.186986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:29.187441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:29.187868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:29.251395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:29.260119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25af098b-ba96-4c3c-bf14-7aa754bc9cef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085684 Sep 19 12:21:29.260685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1412/2787] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:30.284323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:30.284925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:30.287234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:30.292536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:30.293023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:30.293458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:30.294182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:30.294633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:30.295055 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:30.356495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:30.364640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94e57a83-63cb-4bab-b994-254f266e65c3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084243 Sep 19 12:21:30.365206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1376/2788] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:31.388659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:31.389289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:31.396092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:31.396581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:31.397016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:31.397704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:31.398238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:31.398615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:31.401789 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:31.465198 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:31.473752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-304fcad3-1ac6-4a26-86f7-f550bc46df30 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089037 Sep 19 12:21:31.474354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1413/2789] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:32.497068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:32.497631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:32.504021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:32.504510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:32.504948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:32.505641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:32.506129 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:32.506558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:32.567141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:32.575888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96838dfa-364a-4298-8b8e-31e077bb7420 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083312 Sep 19 12:21:32.576490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1377/2790] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:33.599148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:33.599742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:33.606306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:33.606786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:33.607228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:33.607960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:33.608350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:33.608768 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:33.674764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:33.683137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5e61c5a-94ab-41ba-9050-e4c7035347a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087839 Sep 19 12:21:33.683704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1414/2791] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:34.705923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:34.706761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:34.714178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:34.714664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:34.715100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:34.715790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:34.716246 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:34.716668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:34.777031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:34.785279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3d265c2c-227d-40fe-a46e-55fb531667c6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083370 Sep 19 12:21:34.785853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1378/2792] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:35.809137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:35.809729 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:35.812082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:35.817559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:35.818069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:35.818503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:35.819181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:35.819630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:35.820050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:35.885423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:35.893609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6e757ae-d41e-4ce2-8443-11ec003391a6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088891 Sep 19 12:21:35.894200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1415/2793] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:36.916572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:36.917177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:36.923664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:36.924151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:36.924582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:36.925271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:36.925721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:36.926173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:36.930557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:21:36.986911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:36.995666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-015cceae-02da-42b1-b025-3b859095deff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083141 Sep 19 12:21:36.996239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1379/2794] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:38.019536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:38.020230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:38.028354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:38.029164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:38.029993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:38.030722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:38.031285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:38.031719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:38.103160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:38.111513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-356229e7-c259-4069-a91b-a66c68b8cca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.095967 Sep 19 12:21:38.112085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1416/2795] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:39.135674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:39.136309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:39.142801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:39.143288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:39.143726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:39.144424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:39.144876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:39.145299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:39.214374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:39.222500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e57cdf74-7f49-4d84-ac1a-9bf7f01e9c40 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091308 Sep 19 12:21:39.223075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1380/2796] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:40.245250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:40.245886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:40.252385 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:40.252874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:40.253310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:40.254035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:40.254494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:40.254921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:40.315301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:40.323923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a5fee6e-22e9-4683-9071-60f7b09dce85 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082573 Sep 19 12:21:40.324481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1417/2797] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:41.348155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:41.348744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:41.355956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:41.356438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:41.356872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:41.357571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:41.358037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:41.358464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:41.420389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:41.428635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1127b598-62e3-493c-a768-5e5a5295ce1c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084306 Sep 19 12:21:41.429207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1381/2798] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:42.452378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:42.453344 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:42.464390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:42.465220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:42.465703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:42.466440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:42.466906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:42.467329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:42.535353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:42.543778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce7bc2f2-2ab8-406d-b950-132da9a3cb1a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.095492 Sep 19 12:21:42.544345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1418/2799] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:43.566848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:43.567472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:43.573917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:43.574401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:43.574837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:43.575533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:43.575991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:43.576415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:43.638138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:43.647195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a43ae423-2f45-4d8d-8fe5-60fbb4deec79 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084260 Sep 19 12:21:43.647973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1382/2800] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:44.673656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:44.673656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:44.678372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:44.678847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:44.679304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:44.680679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:44.681123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:44.681541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:44.743416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:44.751582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae809170-853c-43f1-99eb-9481c3461d7b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084570 Sep 19 12:21:44.752148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1419/2801] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:45.774537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:45.775142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:45.781636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:45.782153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:45.782587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:45.783272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:45.783725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:45.784145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:45.844907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:45.854102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad8aecc4-0185-4166-9f6f-4331100043a4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083381 Sep 19 12:21:45.854673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1383/2802] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:46.877141 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:46.877754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:46.884338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:46.884823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:46.885258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:46.885982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:46.886437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:46.886863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:46.950584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:46.958685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-276485bb-20ef-4ed7-b1ff-72e974223061 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085416 Sep 19 12:21:46.959245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1420/2803] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:47.983036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:47.983618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:47.989967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:47.990454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:47.990896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:47.991593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:47.992616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:47.993063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:48.052677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:48.061442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-54307576-065a-4278-b311-dbc2b0806ee0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082396 Sep 19 12:21:48.062061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1384/2804] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:21:49.083893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:49.084528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:49.091138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:49.091629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:49.092062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:49.092746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:49.093197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:49.093621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:49.154238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:49.162384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8652b4e0-83f2-479f-9847-38c937ffa3af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082441 Sep 19 12:21:49.162941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1421/2805] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:50.185987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:50.186602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:50.193033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:50.193518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:50.193987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:50.194681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:50.195625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:50.196052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:50.259831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:50.268064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-461a7661-d038-4b0b-b2e1-3cedf0a2f0b8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086081 Sep 19 12:21:50.268620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1385/2806] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:51.291967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:51.292573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:51.299043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:51.299527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:51.299961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:51.300659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:51.301111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:51.301531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:51.369818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:51.378462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cdb98cef-0b85-4d5e-a458-c015980459f1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090886 Sep 19 12:21:51.379055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1422/2807] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:52.402914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:52.403490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:52.410045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:52.410533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:52.410976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:52.411667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:52.412122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:52.412548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:52.477003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:52.485602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57cbd8e0-d880-49a8-bdd2-c6ffc09cf247 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086808 Sep 19 12:21:52.486204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1386/2808] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:53.508837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:53.509488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:53.515760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:53.516258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:53.516666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:53.517350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:53.517820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:53.518241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:53.580040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:53.590053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b66dd6f4-2c84-4618-ad2a-acc1fd185c5e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085086 Sep 19 12:21:53.590623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1423/2809] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:54.614505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:54.615219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:54.622216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:54.622709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:54.623147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:54.623846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:54.624302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:54.624725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:54.685821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:54.694068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fabfb509-2f50-4a00-bcb9-e2d1d2429afb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084274 Sep 19 12:21:54.694639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1387/2810] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:55.716988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:55.717595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:55.724012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:55.724492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:55.724928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:55.725670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:55.726223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:55.726655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:55.789223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:55.797499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70be977f-0ee9-4143-9c81-5f4c9c95e80f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084702 Sep 19 12:21:55.798083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1424/2811] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:56.820938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:56.821575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:56.828127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:56.828611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:56.829048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:56.829739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:56.830306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:56.830732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:56.891914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:56.900896 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa423f35-8389-45b5-9ef4-9d033ce73f15 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084285 Sep 19 12:21:56.901466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1388/2812] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:57.924074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:57.925197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:57.931937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:57.932423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:57.932855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:57.933548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:57.934032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:57.934476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:57.996285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:58.004501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9635f684-4d6b-4220-9936-37e003dd3f71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084648 Sep 19 12:21:58.005066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1425/2813] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:21:59.028721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:21:59.029335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:21:59.035425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:59.035915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:59.036355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:59.037054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:21:59.037509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:21:59.037979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:21:59.098869 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:21:59.107892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8dccf9d6-50c2-4eef-9e88-d8f6fa25e399 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083186 Sep 19 12:21:59.108480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1389/2814] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:21:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:00.130353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:00.131046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:00.137612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:00.138136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:00.138571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:00.139256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:00.139707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:00.140128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:00.204725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:00.213856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06d4faaa-9b15-4ed6-99b4-f4355646607f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087340 Sep 19 12:22:00.214421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1426/2815] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:01.236779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:01.237425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:01.239929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:01.245965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:01.246447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:01.246880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:01.247573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:01.248026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:01.248451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:01.313577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:01.321805 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-afbaf892-d843-4a76-a048-648e22a1ef4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089233 Sep 19 12:22:01.322371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1390/2816] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:02.345045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:02.345651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:02.351991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:02.352472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:02.352906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:02.353589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:02.354071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:02.354496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:02.358383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:02.415303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:02.423351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-416e78a1-09c8-422f-9285-eef6be3a51a3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082226 Sep 19 12:22:02.423917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1427/2817] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:03.446517 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:03.447081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:03.453516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:03.454037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:03.454478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:03.455177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:03.455630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:03.456057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:03.518316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:03.526463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-231b16d1-148a-49d8-8615-6af0f1c8748a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083901 Sep 19 12:22:03.527033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1391/2818] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:04.549971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:04.550577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:04.557402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:04.557901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:04.558329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:04.559007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:04.559452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:04.559868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:04.625084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:04.633731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-827bbffd-6ff2-4a3f-901d-14606d12b9a8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087756 Sep 19 12:22:04.634309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1428/2819] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:05.657350 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:05.657971 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:05.665087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:05.665565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:05.666034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:05.666717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:05.667161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:05.667578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:05.728480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:05.736764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6b1e8c4-868b-41bb-9468-1df2a4a6e0f2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083667 Sep 19 12:22:05.737340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1392/2820] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:06.759974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:06.760573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:06.762480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:06.767665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:06.768149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:06.768589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:06.769283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:06.769735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:06.770185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:06.834193 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:06.843138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d43a752-3be0-4462-a893-2581726686b0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087210 Sep 19 12:22:06.843695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1429/2821] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:07.866298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:07.866918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:07.873477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:07.873939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:07.874377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:07.875067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:07.875522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:07.875949 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:07.879843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:07.938757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:07.947329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29de42d5-486e-4cec-9695-8930c880f9ff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085033 Sep 19 12:22:07.947888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1393/2822] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:08.970743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:08.971371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:08.978442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:08.978927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:08.979368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:08.980057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:08.980512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:08.980934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:09.044041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:09.052210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62d4d30e-47bd-49ce-bc92-baeac81bae75 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085337 Sep 19 12:22:09.052776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1430/2823] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:10.076666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:10.077270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:10.083671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:10.084152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:10.084586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:10.085273 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:10.085724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:10.086180 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:10.146834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:10.155081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17016d6c-b663-489f-bb31-349d6a7dfb67 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082320 Sep 19 12:22:10.155643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1394/2824] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:11.178350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:11.179586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:11.185962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:11.186450 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:11.186882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:11.187570 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:11.188021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:11.188445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:11.249147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:11.257318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ad2c28f-1585-4d01-9da7-db3c3383009e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082933 Sep 19 12:22:11.257970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1431/2825] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:12.280231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:12.280846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:12.287317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:12.287799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:12.288236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:12.288926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:12.289390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:12.289830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:12.351223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:12.359388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-35aebc7e-d388-486f-994c-72fc6ee95a0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083084 Sep 19 12:22:12.359950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1395/2826] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:13.383155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:13.383690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:13.390095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:13.390576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:13.391008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:13.391694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:13.392146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:13.392566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:13.456751 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:13.465215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-210b1f45-738b-4181-9696-e6b35fac0618 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086540 Sep 19 12:22:13.465787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1432/2827] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:14.489062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:14.489614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:14.496450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:14.496937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:14.497369 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:14.498095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:14.498549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:14.498990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:14.559865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:14.568166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c0c6327-e56f-4ad8-9bd5-451e21df24ca tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083064 Sep 19 12:22:14.568734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1396/2828] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:22:15.591384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:15.592026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:15.598538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:15.599021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:15.599455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:15.600142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:15.601839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:15.601839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:15.661382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:15.670073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72fb3b2b-1110-49eb-a54e-4f0aeff4d9d9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082777 Sep 19 12:22:15.670642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1433/2829] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:16.693345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:16.693910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:16.700316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:16.700798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:16.701233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:16.701951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:16.702404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:16.702827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:16.763303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:16.771368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7d902ca6-20d0-4beb-9326-92d25c391fcc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.081948 Sep 19 12:22:16.771954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1397/2830] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:17.794929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:17.795534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:17.802176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:17.802654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:17.803089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:17.803803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:17.804270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:17.804672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:17.869242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:17.877880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-822f91bd-25e1-4d30-88ba-d909502f211c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086610 Sep 19 12:22:17.878372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1434/2831] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:18.903009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:18.903669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:18.910697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:18.911194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:18.911625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:18.912339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:18.913481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:18.914084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:18.981794 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:18.990226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c957c943-0289-4819-af63-1050d8e852a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091257 Sep 19 12:22:18.991102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1398/2832] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:20.014336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:20.014916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:20.021600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:20.022754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:20.023271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:20.023979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:20.024433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:20.024855 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:20.092442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:20.101442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-533d3fdd-ba47-4171-a827-4153013a246d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091265 Sep 19 12:22:20.102070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1435/2833] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:21.124220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:21.124823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:21.131950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:21.132442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:21.132880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:21.133592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:21.134075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:21.134552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:21.198460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:21.206911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-03cf027a-b5ec-4561-869d-81e646050c99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086652 Sep 19 12:22:21.207634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1399/2834] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:22.231811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:22.232460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:22.239389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:22.239878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:22.240319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:22.241641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:22.242126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:22.242546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:22.308909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:22.317829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55f82a3c-4f45-4cd9-9abf-cab56b8b99d5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089787 Sep 19 12:22:22.318419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1436/2835] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:23.341846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:23.342455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:23.349252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:23.349852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:23.350304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:23.351017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:23.351478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:23.351908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:23.417724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:23.426034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6316f803-6b40-491f-b192-b1615328ad69 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088321 Sep 19 12:22:23.426601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1400/2836] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:24.451973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:24.452960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:24.464384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:24.464996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:24.465560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:24.466363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:24.466824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:24.467261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:24.528488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:24.536596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd9e381a-b3fb-488b-8944-2e3550027ddc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090840 Sep 19 12:22:24.537169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1437/2837] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:25.560865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:25.561681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:25.568120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:25.568601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:25.569032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:25.569799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:25.570288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:25.570784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:25.634377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:25.642482 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71516c24-b4e3-4aff-8794-5cc0d2e8392c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085559 Sep 19 12:22:25.643045 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1401/2838] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:26.666626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:26.667176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:26.673504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:26.674026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:26.674460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:26.675142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:26.675593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:26.676017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:26.790705 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:26.799295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da5e6e4c-378e-4154-b0f6-9f3463df3342 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.137315 Sep 19 12:22:26.799860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1438/2839] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:27.822192 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:27.822793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:27.829182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:27.829664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:27.830148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:27.830824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:27.831281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:27.831714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:27.892041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:27.900609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-60d782c4-005a-4a0b-9bd9-336142537ff1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082418 Sep 19 12:22:27.901168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1402/2840] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:28.927872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:28.929136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:28.935548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:28.936028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:28.936463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:28.937156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:28.937609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:28.938061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:29.001796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:29.010343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f23802dd-f2eb-4446-8009-30bf79051039 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086236 Sep 19 12:22:29.010916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1439/2841] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:30.033630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:30.034283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:30.040731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:30.041227 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:30.041664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:30.042390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:30.042853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:30.043310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:30.111750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:30.120650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-40f3a7d5-cadc-4b47-8a1f-8a36b5b10da5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091036 Sep 19 12:22:30.121231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1403/2842] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:31.144430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:31.145048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:31.151639 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:31.152119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:31.152552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:31.153265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:31.153717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:31.154160 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:31.217149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:31.226032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0929350a-98b9-4bbb-919a-a994477bab24 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085574 Sep 19 12:22:31.226591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1440/2843] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:32.249587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:32.250286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:32.252846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:32.258349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:32.258825 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:32.259258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:32.259944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:32.260393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:32.260808 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:32.321057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:32.329172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9843667-ce60-429b-ba84-ce514a472aaa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083471 Sep 19 12:22:32.329730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1404/2844] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:33.352868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:33.353463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:33.360041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:33.360516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:33.360941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:33.361623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:33.362103 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:33.362519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:33.365077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:33.429429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:33.437623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d86df4a-19ab-404d-8958-f39c3055c91f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088660 Sep 19 12:22:33.438507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1441/2845] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:34.460600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:34.461193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:34.467837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:34.468322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:34.468761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:34.469457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:34.469951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:34.470380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:34.530824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:34.539594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a6e06bf1-0b47-4c06-8519-2523cc380668 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082938 Sep 19 12:22:34.540165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1405/2846] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:35.684150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:35.684762 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:35.690749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:35.691231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:35.691667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:35.692357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:35.692809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:35.693233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:35.756606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:35.765805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0c8b62a-2369-4a86-9dc8-9c93a7751fea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.206176 Sep 19 12:22:35.766367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1442/2847] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:36.790306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:36.790957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:36.797360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:36.797877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:36.798320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:36.799017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:36.799475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:36.799900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:36.861234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:36.870011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36516fd2-e4be-4450-975f-a4ba6298737b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083852 Sep 19 12:22:36.870576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1406/2848] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:37.894235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:37.894802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:37.897117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:37.902093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:37.902582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:37.903020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:37.903704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:37.904150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:37.904566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:37.967216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:37.975438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72b4e055-953e-412b-ae14-18620f223ed1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085397 Sep 19 12:22:37.976012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1443/2849] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:39.001336 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:39.001962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:39.008767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:39.009243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:39.009673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:39.010388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:39.010840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:39.011265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:39.013799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:22:39.075020 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:39.083307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a7a8504-d0a3-4697-ab0c-2a997d28a524 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085883 Sep 19 12:22:39.083873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1407/2850] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:40.106510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:40.107104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:40.113481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:40.113989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:40.114418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:40.115586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:40.116027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:40.116443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:40.180205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:40.188367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba2baffa-2457-40d3-bb6d-079c0fe9eea8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085735 Sep 19 12:22:40.188918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1444/2851] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:41.211371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:41.211981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:41.218727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:41.219210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:41.219674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:41.220361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:41.220810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:41.221238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:41.281681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:41.290247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-53855a8c-c186-4449-85c9-785c41bcca31 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082862 Sep 19 12:22:41.290810 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1408/2852] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:42.313775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:42.314412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:42.321467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:42.321980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:42.322418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:42.323106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:42.323560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:42.323985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:42.384803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:42.393003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d89cb512-f2af-43c3-8871-7c2d460095a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083112 Sep 19 12:22:42.393561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1445/2853] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:43.416751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:43.417327 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:43.423668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:43.424142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:43.424587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:43.425248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:43.425695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:43.426135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:43.488983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:43.497846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-36692a39-da22-4368-b0f6-2669c88115f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085055 Sep 19 12:22:43.498411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1409/2854] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:44.520765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:44.521404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:44.528055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:44.528538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:44.528966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:44.529654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:44.530133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:44.530559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:44.602740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:44.614400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca3065da-376d-4b61-99a4-959cd77bcc6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.097127 Sep 19 12:22:44.615771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1446/2855] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:45.647821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:45.648423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:45.654995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:45.655481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:45.655919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:45.656623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:45.657150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:45.657578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:45.723253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:45.731697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f559d9e8-ca25-488b-bc26-8170233169b5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088364 Sep 19 12:22:45.732282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1410/2856] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:46.755096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:46.755732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:46.761989 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:46.762473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:46.762906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:46.763593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:46.764049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:46.764473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:46.825531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:46.834388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8f49fb3-17d0-49a4-a61e-b3b891c88b0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082755 Sep 19 12:22:46.835020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1447/2857] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:47.858425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:47.859050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:47.861010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:22:47.861168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:22:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:22:47.868855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:47.869268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:47.869711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:47.870521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:47.871003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:47.871460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:47.936525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:47.945381 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2e7b47cf-0396-411e-a249-960bc22ea7f6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090799 Sep 19 12:22:47.945996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1411/2858] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:22:48.969087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:48.969710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:48.976458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:48.976957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:48.977419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:48.978226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:48.978679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:48.979111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:49.046709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:49.055670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf3afd50-baef-492a-86c1-3727dce3a3ac tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090432 Sep 19 12:22:49.056250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1448/2859] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:50.079924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:50.080526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:50.087912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:50.088389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:50.088817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:50.089505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:50.089987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:50.090406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:50.152715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:50.161661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff28ea75-f455-459b-a656-4f3bec0bb1c0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085518 Sep 19 12:22:50.162268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1412/2860] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:51.184595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:51.185239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:51.191856 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:51.192342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:51.193416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:51.194130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:51.194578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:51.194999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:51.257588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:51.266083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40b76e9a-f083-48fd-8ce4-5548a2292350 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085284 Sep 19 12:22:51.266643 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1449/2861] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:52.288775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:52.289380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:52.295994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:52.296657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:52.297226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:52.297999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:52.298501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:52.298980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:52.365494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:52.373962 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-de31ce17-5cb5-40da-9873-f1e58adfa12d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089085 Sep 19 12:22:52.374545 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1413/2862] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:53.398266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:53.399044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:53.407130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:53.407651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:53.408089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:53.408783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:53.409239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:53.409700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:53.476218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:53.484538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6a9c4bd-b507-4ba6-918c-fefb21c0662f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090911 Sep 19 12:22:53.485100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1450/2863] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:54.508678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:54.509240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:54.511204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:22:54.511339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:22:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:22:54.517724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:54.518235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:54.518677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:54.519375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:54.519822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:54.520253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:54.582139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:54.591333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6539f369-d835-417f-a646-63cea8820f8c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087149 Sep 19 12:22:54.591895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1414/2864] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:55.611009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:22:55.611641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:22:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:22:55.616893 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:55.617497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:55.624049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:55.624530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:55.624964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:55.625649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:55.626136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:55.626558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:55.687845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:55.696000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d83ed8d-f228-4ee7-a63f-cb69b3998530 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085914 Sep 19 12:22:55.696565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1451/2865] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:56.721373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:56.721972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:56.728335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:56.728823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:56.729258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:56.729999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:56.730454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:56.730882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:56.841501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:56.849832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-99aafc67-410a-4f45-b083-6f7e238f8865 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.133180 Sep 19 12:22:56.850398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1415/2866] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:57.872634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:57.873234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:57.879686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:57.880172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:57.880608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:57.881295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:57.881749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:57.882196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:57.945043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:57.953306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2d7aa27-e3bd-4145-8dac-9f2eb222a1f3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084545 Sep 19 12:22:57.953891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1452/2867] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:22:58.977222 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:22:58.977873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:22:58.983955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:58.984434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:58.984870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:58.985561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:22:58.986043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:22:58.986475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:22:59.046809 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:22:59.055003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b516661f-6002-4599-870b-5f574916c8f8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.081761 Sep 19 12:22:59.055573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1416/2868] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:22:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:00.080276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:00.080917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:00.087967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:00.088449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:00.088885 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:00.089579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:00.090066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:00.090494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:00.158967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:00.168645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec0ced03-89ae-4929-937a-14d622c0a2ed tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.093646 Sep 19 12:23:00.169209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1453/2869] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:01.192016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:01.193164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:01.199832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:01.200330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:01.200755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:01.201489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:01.201912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:01.202332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:01.263939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:01.272926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0fbc091f-2a0c-4e8d-95c7-4e1337e1eb5c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084764 Sep 19 12:23:01.273490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1417/2870] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:02.297396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:02.298508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:02.305519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:02.306041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:02.306478 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:02.307170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:02.307624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:02.308050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:02.371215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:02.379470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4543c364-b556-42b5-b72c-34b06bd00816 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086586 Sep 19 12:23:02.380672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1454/2871] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:03.403648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:03.404203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:03.406616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:03.412353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:03.412833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:03.413269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:03.413980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:03.414430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:03.414850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:03.476429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:03.484559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3e36f1d-adfe-4afb-9729-13dae6715d20 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084823 Sep 19 12:23:03.485121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1418/2872] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:04.508143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:04.508700 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:04.515318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:04.515799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:04.516234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:04.516927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:04.517383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:04.517847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:04.521777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:04.581865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:04.590908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1bc4be06-f619-4bae-b4ed-df798a29796d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086731 Sep 19 12:23:04.591480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1455/2873] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:05.613725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:05.614835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:05.621481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:05.622016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:05.622452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:05.623149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:05.623600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:05.624024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:05.684685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:05.692998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ec9898ec-20dc-48cb-a33f-b343497cc1e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083198 Sep 19 12:23:05.693566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1419/2874] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:06.716387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:06.716979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:06.722971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:06.723446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:06.723882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:06.724556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:06.725012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:06.725429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:06.788001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:06.796668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7733e37-02fa-45a2-a10d-e33c2c56afda tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084484 Sep 19 12:23:06.797253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1456/2875] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:07.821322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:07.821960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:07.828399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:07.828881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:07.829317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:07.830034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:07.830485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:07.830904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:07.893299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:07.902051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa47e5e5-4cf0-42ea-90a9-6a1e96669e43 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084604 Sep 19 12:23:07.902556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1420/2876] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:08.925784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:08.926417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:08.928661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:08.933868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:08.934357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:08.934792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:08.935483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:08.935940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:08.936367 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:08.997219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:09.005876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11867fab-e4b9-4c7c-bdf4-92c2a72bea0b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083989 Sep 19 12:23:09.006435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1457/2877] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:10.029358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:10.029999 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:10.036977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:10.037456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:10.037926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:10.038750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:10.039226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:10.039660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:10.042289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:10.100908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:10.108997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-72416da9-f26f-4294-a7bc-968c9c9bbeb0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083506 Sep 19 12:23:10.109557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1421/2878] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:11.132288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:11.132899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:11.139323 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:11.139807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:11.140234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:11.140917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:11.141358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:11.141831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:11.206030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:11.214816 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03afca36-3186-4a19-bc28-885e5911aee5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086495 Sep 19 12:23:11.215395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1458/2879] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:12.239204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:12.239844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:12.246527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:12.247027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:12.247466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:12.248177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:12.248631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:12.249059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:12.312780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:12.322519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2cdd3d3a-468e-42b2-8e8b-7151733140fa tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087869 Sep 19 12:23:12.323355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1422/2880] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:12 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:13.346165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:13.346728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:13.353082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:13.353559 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:13.354028 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:13.354713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:13.355161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:13.355579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:13.417967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:13.426957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a12e5d01-940e-401a-a0a0-8e74fcdaeb71 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084117 Sep 19 12:23:13.427532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1459/2881] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:14.450061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:14.450598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:14.452580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:23:14.452717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:23:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:23:14.459464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:14.459956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:14.460395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:14.461096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:14.461554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:14.462010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:14.524378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:14.532725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3749dfc5-2c8a-40fa-808b-349041a720e4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086734 Sep 19 12:23:14.533299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1423/2882] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:15.557393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:15.558032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:15.564509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:15.564996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:15.565432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:15.566163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:15.566609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:15.567522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:15.633351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:15.641481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4230d399-dafb-4a39-8ff1-c0d3648a079a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089558 Sep 19 12:23:15.642075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1460/2883] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:16.666049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:16.666614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:16.672934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:16.673414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:16.673875 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:16.674593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:16.675043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:16.675465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:16.735817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:16.743822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-027ca054-b93c-465b-8103-4b823d5bc814 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.081874 Sep 19 12:23:16.744385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1424/2884] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:17.766384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:17.766963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:17.773379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:17.773884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:17.774314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:17.774991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:17.775440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:17.775848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:17.836359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:17.844696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b55ddfe6-e13e-405f-87eb-2e9afcaacf42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082144 Sep 19 12:23:17.845252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1461/2885] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:18.868347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:18.868960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:18.875419 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:18.875908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:18.876346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:18.877039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:18.877495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:18.877954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:18.937721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:18.946508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-bfc3296e-b7d3-4da5-85d4-ea919dee9226 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082045 Sep 19 12:23:18.947080 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1425/2886] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:19.968738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:19.969334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:19.976394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:19.976881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:19.977315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:19.978046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:19.978503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:19.978930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:20.043364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:20.052086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67cfcc5f-db82-4bf8-b498-1e131ed03579 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086739 Sep 19 12:23:20.052653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1462/2887] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:21.075018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:21.075628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:21.082123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:21.082619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:21.083057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:21.083746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:21.084201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:21.084625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:21.148014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:21.156070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2bb95205-a309-4dc5-8a88-015861bc766b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084970 Sep 19 12:23:21.156640 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1426/2888] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:22.179295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:22.179891 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:22.186313 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:22.186783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:22.187208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:22.187883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:22.188328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:22.188745 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:22.256555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:22.265568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb0d6644-241b-4afa-9a38-292e5c538377 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090228 Sep 19 12:23:22.266214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1463/2889] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:22 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:23:23.291249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:23.291888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:23.298252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:23.298735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:23.299167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:23.299855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:23.300309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:23.300811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:23.362471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:23.370923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0cff5a02-d8ab-4781-9169-f7a73bec9837 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083566 Sep 19 12:23:23.371532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1427/2890] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:24.395250 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:24.395866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:24.402446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:24.402864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:24.403297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:24.403983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:24.404437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:24.404857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:24.470656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:24.479305 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec2b4473-eafb-4c86-a598-f8fce5420786 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088548 Sep 19 12:23:24.479884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1464/2891] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:25.502052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:25.502618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:25.509236 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:25.509725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:25.510196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:25.510904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:25.511360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:25.511834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:25.575342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:25.584523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-17e5e439-02e5-4156-8491-e5acf9a6aec3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086446 Sep 19 12:23:25.585106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1428/2892] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:26.608321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:26.608933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:26.615750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:26.616233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:26.616666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:26.617356 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:26.617844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:26.618265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:26.680748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:26.689298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca5a4d78-5a84-4a72-8ea7-0db2d49460ec tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084789 Sep 19 12:23:26.689915 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1465/2893] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:27.713415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:27.714104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:27.720530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:27.721018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:27.721454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:27.722173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:27.722629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:27.723053 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:27.784555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:27.792960 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-51b1fad0-4802-44c1-841b-22212251c821 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083591 Sep 19 12:23:27.793535 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1429/2894] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:28.816981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:28.817593 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:28.824451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:28.824947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:28.825384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:28.826127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:28.826589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:28.827012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:28.895642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:28.904424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08ae4401-2119-479c-95f1-511030631d12 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091346 Sep 19 12:23:28.904988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1466/2895] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:29.929087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:29.929686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:29.936085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:29.936580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:29.937017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:29.937721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:29.938202 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:29.938630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:30.003075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:30.011663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2fc129c3-3776-4245-ac1f-1fc7b1e5c234 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086909 Sep 19 12:23:30.012175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1430/2896] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:23:31.033829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:31.034468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:31.041538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:31.042046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:31.042480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:31.043166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:31.043609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:31.044027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:31.106467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:31.115443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8c63eed-ab9d-4823-95e6-50794f0d187a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085464 Sep 19 12:23:31.116014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1467/2897] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:32.138841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:32.139435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:32.146727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:32.147212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:32.147639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:32.148827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:32.148827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:32.149197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:32.211479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:32.220186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b52628d8-f3c8-429c-a9db-a7ed0c1c16dc tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085155 Sep 19 12:23:32.220755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1431/2898] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:32 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:33.244168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:33.244777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:33.252192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:33.252707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:33.253136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:33.254897 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:33.255026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:33.255401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:33.324736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:33.333142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29687bbe-3b48-4415-964d-93f5332895d3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.092955 Sep 19 12:23:33.333938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1468/2899] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:34.356195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:34.356798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:34.359209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:34.365000 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:34.365491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:34.365961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:34.366680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:34.367141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:34.367568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:34.429658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:34.438042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71fc0645-c086-45b7-8044-39b056cd80ce tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085612 Sep 19 12:23:34.438560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1432/2900] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:35.460490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:35.461114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:35.468130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:35.468624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:35.469064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:35.469787 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:35.470262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:35.470694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:35.473425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:35.534395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:35.542931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-84953032-24fb-4e75-9de2-60f069504040 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086273 Sep 19 12:23:35.543495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1469/2901] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:36.566768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:36.567404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:36.574540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:36.575031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:36.575460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:36.576175 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:36.576629 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:36.577049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:36.645740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:36.654034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b8878bb7-91e4-48c1-8599-f6029f96abc0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091312 Sep 19 12:23:36.654611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1433/2902] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:37.680146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:37.680976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:37.688232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:37.688709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:37.689142 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:37.689857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:37.690310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:37.690730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:37.757406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:37.767436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a434f1a-ddf3-49d5-b25e-ebe7e10e5e72 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.092369 Sep 19 12:23:37.768002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1470/2903] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:23:38.791467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:38.792086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:38.798585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:38.799060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:38.799486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:38.800166 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:38.800613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:38.801037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:38.861464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:38.869609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97414c1d-3361-4113-90da-6bc0ded52eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082159 Sep 19 12:23:38.870233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1434/2904] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:39.893029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:39.893635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:39.896433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:39.901822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:39.902306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:39.902740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:39.903425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:39.903876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:39.904299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:39.964926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:39.975014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68229fc1-e758-4b2f-a769-2c578a044a18 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085801 Sep 19 12:23:39.975585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1471/2905] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:40.998541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:40.999145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:41.005789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:41.006292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:41.006734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:41.007507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:41.007974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:41.008402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:41.012321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:23:41.069577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:41.077915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-673b7f00-592a-459e-8574-e7ea4837478b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083167 Sep 19 12:23:41.078449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1435/2906] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:42.101904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:42.102510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:42.108976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:42.109456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:42.109919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:42.110610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:42.111059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:42.111481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:42.176011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:42.184149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a394d47-fd09-4b47-88df-8f0287203896 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086118 Sep 19 12:23:42.184720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1472/2907] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:43.207718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:43.208324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:43.215013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:43.215493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:43.215922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:43.216772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:43.217216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:43.217633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:43.278107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:43.286879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-41b1190a-2905-4238-b7d3-2c159576b2a0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083004 Sep 19 12:23:43.287437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1436/2908] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:43 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:44.311189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:44.311803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:44.318197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:44.318686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:44.319119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:44.319806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:44.320255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:44.320678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:44.386561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:44.395543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-710e4b00-ae32-461b-8555-45fe2ba95496 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088245 Sep 19 12:23:44.396101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1473/2909] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:45.419324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:45.419894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:45.426911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:45.427400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:45.427838 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:45.428534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:45.428991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:45.429420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:45.489979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:45.498190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d55516c1-1ee9-4d8b-815e-be6ff7531a0d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082777 Sep 19 12:23:45.498761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1437/2910] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:46.521121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:46.521732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:46.528239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:46.528728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:46.529163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:46.529877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:46.530330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:46.530750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:46.594585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:46.603406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-404f2a93-c2df-4be9-a7dd-1875d1002d93 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086184 Sep 19 12:23:46.603979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1474/2911] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:47.625547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:47.626224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:47.632650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:47.633137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:47.633568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:47.634279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:47.634733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:47.635153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:47.696464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:47.704842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-79161bf2-e588-4f9f-9201-0b15bd87a181 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083110 Sep 19 12:23:47.705449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1438/2912] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:48.728423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:48.729009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:48.735522 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:48.736001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:48.736429 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:48.737507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:48.738257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:48.738911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:48.804265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:48.813439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcca1f7d-4a7e-4841-8fdb-04f6b3a870d8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088790 Sep 19 12:23:48.813975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1475/2913] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:49.837672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:49.838333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:49.844975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:49.845462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:49.845955 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:49.847312 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:49.847778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:49.848205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:49.911143 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:49.919466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ae8a4b86-3fc9-4b32-9005-0700205e0481 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085922 Sep 19 12:23:49.920040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1439/2914] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:50.943490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:50.944117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:50.951100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:50.951606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:50.952069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:50.952780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:50.953233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:50.953659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:51.021246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:51.029627 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2fe1586b-ffbc-4e8c-af8e-d9c6706a9eaf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090521 Sep 19 12:23:51.030237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1476/2915] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:23:52.053160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:52.053795 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:52.060476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:52.061059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:52.061568 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:52.062394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:52.063017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:52.063445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:52.131703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:52.140150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7b93d714-2d9a-4eb9-bfa0-11dbb583c907 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091490 Sep 19 12:23:52.140819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1440/2916] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:52 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:53.164464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:53.165055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:53.171503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:53.171980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:53.172406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:53.173091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:53.173532 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:53.173977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:53.237364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:53.245697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bac067e-7581-4ffd-87e0-b81db9022ba6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085375 Sep 19 12:23:53.246292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1477/2917] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:54.269726 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:54.270365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:54.276758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:54.277240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:54.277676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:54.278396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:54.278863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:54.279314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:54.341839 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:54.350821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ff76de12-2972-4b4e-8cf9-2ea12f15ee0c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085500 Sep 19 12:23:54.351395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1441/2918] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:55.374591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:55.375312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:55.382909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:55.383390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:55.383818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:55.384502 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:55.384945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:55.385362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:55.448928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:55.457868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b146a62-e0cb-4a5a-9834-ad21d20e7c2c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087554 Sep 19 12:23:55.458442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1478/2919] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:56.480425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:56.481135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:56.487623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:56.488142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:56.488573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:56.489249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:56.489692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:56.490171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:56.550396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:56.558395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4befb045-735f-465c-8e16-38d21042433d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.081840 Sep 19 12:23:56.558956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1442/2920] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:57.581280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:57.581914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:57.588624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:57.589089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:57.589531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:57.590246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:57.590703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:57.591129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:57.651063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:57.659810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24dcc428-8ea7-4b5c-b345-3840b91c9243 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082425 Sep 19 12:23:57.660372 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1479/2921] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:58.683346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:58.683974 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:58.690822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:58.691339 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:58.691768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:58.692453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:58.692898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:58.693316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:58.755725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:58.766643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-db1a3ed7-f62b-4d9b-8be0-5aaa01184a6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087330 Sep 19 12:23:58.767267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1443/2922] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:23:59.793328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:23:59.793971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:23:59.800422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:59.800896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:59.801325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:59.802041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:23:59.802513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:23:59.802924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:23:59.869100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:23:59.880150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7fa17b70-950a-4104-a5ee-9b3994800de1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090309 Sep 19 12:23:59.881114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1480/2923] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:23:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:00.908039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:00.908648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:00.916126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:00.916612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:00.917049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:00.917788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:00.918253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:00.918684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:00.981558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:00.990610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4f437437-67c0-417e-b8aa-a2f400c25672 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086498 Sep 19 12:24:00.991370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1444/2924] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:02.013602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:02.014357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:02.021712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:02.022226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:02.022662 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:02.023360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:02.023812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:02.024265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:02.086609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:02.095701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8d82dca-db1c-49ca-b3a5-9b3bbd5033ef tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085878 Sep 19 12:24:02.096312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1481/2925] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:02 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:03.119360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:03.119972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:03.129106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:03.130157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:03.130702 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:03.131413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:03.131866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:03.132298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:03.195005 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:03.203707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-040654b4-889e-4d7f-9f8d-6f9438af3a0e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088012 Sep 19 12:24:03.204178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1445/2926] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:04.227752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:04.228363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:04.234737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:04.235216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:04.235653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:04.236340 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:04.237375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:04.237820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:04.301702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:04.309877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56388649-10c8-40e0-9e10-a781bf0768b1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085979 Sep 19 12:24:04.310453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1482/2927] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:05.333689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:05.334592 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:05.337089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:05.343205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:05.343740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:05.344224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:05.345091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:05.345600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:05.346149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:05.428212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:05.437647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e72117a7-f946-4c7e-a240-d56678b77c2b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.108057 Sep 19 12:24:05.438525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1446/2928] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:24:06.480290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:06.480853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:06.487743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:06.488221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:06.488646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:06.489327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:06.489785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:06.490210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:06.494096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:06.552590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:06.560712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06ddd384-5dac-49b7-8cd5-aec514493e04 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084390 Sep 19 12:24:06.561320 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1483/2929] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:07.584219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:07.584905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:07.592403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:07.592892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:07.593340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:07.594152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:07.594613 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:07.595035 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:07.658643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:07.667587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1deccff6-75e4-4ac9-bc35-c2575fcf0b8d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087315 Sep 19 12:24:07.668190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1447/2930] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:08.691742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:08.692366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:08.698594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:08.699076 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:08.699510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:08.700188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:08.700637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:08.701060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:08.763723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:08.772499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f11405c-1f7f-4dd0-bb5a-369309a46a53 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084723 Sep 19 12:24:08.773064 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1484/2931] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:09.796415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:09.797022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:09.803645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:09.804131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:09.804593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:09.805297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:09.806012 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:09.806438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:09.868042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:09.876361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29c47c69-7544-4823-9a61-0aabebdbc6d2 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083771 Sep 19 12:24:09.876941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1448/2932] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:10.900237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:10.900791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:10.903135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:10.908517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:10.908983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:10.909965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:10.910663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:10.911106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:10.911520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:10.973233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:10.981480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-143ca9ef-c729-4590-b8da-3491b86237ee tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085228 Sep 19 12:24:10.982096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1485/2933] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:12.005161 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:12.005735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:12.012109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:12.012596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:12.013058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:12.013805 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:12.014268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:12.014752 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:12.018675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:12.077719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:12.086448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8a907820-e679-4449-8e09-1f9a1fff1473 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085430 Sep 19 12:24:12.087001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1449/2934] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:24:13.109780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:13.110393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:13.117036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:13.117520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:13.118001 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:13.118731 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:13.119185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:13.119607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:13.185678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:13.194680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67bbe2d4-a912-4aee-b749-37971d6fa35f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088851 Sep 19 12:24:13.195253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1486/2935] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:13 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:14.219003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:14.219647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:14.226352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:14.226934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:14.227448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:14.228216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:14.228719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:14.229193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:14.292251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:14.302171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2375ebb2-f640-446d-be04-587f56a056af tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087206 Sep 19 12:24:14.302760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1450/2936] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:15.327656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:15.328219 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:15.334941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:15.335420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:15.335948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:15.336521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:15.336973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:15.337654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:15.398905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:15.407597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eee5225c-5ed0-46a9-95f5-d884db29dd59 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083854 Sep 19 12:24:15.408196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1487/2937] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:15 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:16.431995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:16.432599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:16.439006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:16.439485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:16.439914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:16.440637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:16.441084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:16.441507 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:16.502854 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:16.511337 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8b29928d-12fc-4b93-8b94-b54c23c7a31b tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083228 Sep 19 12:24:16.511933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1451/2938] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:16 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:17.537461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:17.538391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:17.547494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:17.547981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:17.548414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:17.549104 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:17.549560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:17.550018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:17.615272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:17.624101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1669672-2957-4a59-875d-4a46fbe24dfb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091494 Sep 19 12:24:17.624717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1488/2939] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:17 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:18.649189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:18.649844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:18.656201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:18.656686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:18.657124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:18.657844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:18.658303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:18.658732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:18.719316 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:18.727714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0284bc10-07e7-422e-973a-202cc0a0a2b7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082973 Sep 19 12:24:18.728286 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1452/2940] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:18 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:19.750795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:19.751422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:19.757713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:19.758213 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:19.758636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:19.759309 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:19.759754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:19.760170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:19.823353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:19.831580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35d714b1-e096-4473-9f71-03279ec93a64 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084589 Sep 19 12:24:19.832153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1489/2941] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:19 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:20.858311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:20.859097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:20.870712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:20.871492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:20.872101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:20.873295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:20.874111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:20.874650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:20.963601 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:20.972614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f07bc8e-6875-41f6-b947-3d2c55d76d42 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.120142 Sep 19 12:24:20.973682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1453/2942] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:20 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:21.999017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:21.999642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:22.006900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:22.007379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:22.007812 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:22.008509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:22.009018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:22.009442 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:22.077644 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:22.086376 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9684b3e8-6245-4206-9dde-2557b04f34cb tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091136 Sep 19 12:24:22.086970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1490/2943] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:21 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:24:23.111501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:23.112127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:23.118903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:23.119431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:23.119867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:23.120576 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:23.121034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:23.121459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:23.184089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:23.192469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2f2ce9bf-18ac-4b10-9f77-184b40385aff tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084996 Sep 19 12:24:23.193556 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1454/2944] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:23 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:24.216129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:24.216718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:24.223366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:24.223851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:24.225024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:24.225730 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:24.226209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:24.226633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:24.288218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:24.296481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0da2eb6-c83e-44ee-afd6-7de76ae10ca3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084468 Sep 19 12:24:24.297038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1491/2945] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:24 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:24:25.319605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:25.320214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:25.326743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:25.327224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:25.327658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:25.328343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:25.328796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:25.329221 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:25.391169 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:25.399499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6fdceda-dca3-4eae-9679-d79194262f6f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083675 Sep 19 12:24:25.400018 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1455/2946] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:25 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:26.422581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:26.423188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:26.431116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:26.431595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:26.432024 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:26.432709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:26.433154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:26.433862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:26.496842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:26.504947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cec4b7d-9af3-4bad-91eb-1b8702f3fc51 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086296 Sep 19 12:24:26.506164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1492/2947] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:26 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:27.528937 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:27.529571 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:27.536006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:27.536491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:27.536928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:27.537856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:27.538106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:27.538533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:27.599680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:27.607826 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ffe39b39-4cd3-43fe-af7d-d4a4415b2874 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082748 Sep 19 12:24:27.608404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1456/2948] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:27 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:28.631192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:28.631834 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:28.638176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:28.638655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:28.639087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:28.639774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:28.640225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:28.640683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:28.701807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:28.710660 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4c18d91-3c96-45a6-87eb-ef1a04e5bed3 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083308 Sep 19 12:24:28.711202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1493/2949] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:28 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:29.734522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:29.735134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:29.742146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:29.742634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:29.743072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:29.743764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:29.744214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:29.744641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:29.805579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:29.814652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6cfc0074-a4ad-4f3f-a658-de00093b02cf tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084099 Sep 19 12:24:29.815254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1457/2950] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:29 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:30.836608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:30.837166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:30.843826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:30.844307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:30.844744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:30.845431 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:30.845947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:30.846375 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:30.920889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:30.929550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fffab5e0-bac0-43ca-a74f-4d1d3bffdf3d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.096473 Sep 19 12:24:30.930164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1494/2951] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:30 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:31.952468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:31.953057 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:31.959508 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:31.959988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:31.961103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:31.961803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:31.962241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:31.962933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:32.024104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:32.031686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d456a01b-59d8-4566-9716-8c68e6fa5851 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083048 Sep 19 12:24:32.032249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1458/2952] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:31 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:33.054927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:33.055583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:33.061819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:33.062301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:33.062784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:33.063418 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:33.063864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:33.064279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:33.127933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:33.137234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be20fe04-0de4-4888-82c5-383c83e8f77a tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086572 Sep 19 12:24:33.137810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1495/2953] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:33 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:34.160157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:34.160764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:34.167242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:34.167717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:34.168147 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:34.168822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:34.169269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:34.169686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:34.229608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:34.237846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-963cdd9b-bd3f-477e-8f11-516075868612 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.081533 Sep 19 12:24:34.238416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1459/2954] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:34 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:35.260555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:35.261179 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:35.263159 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:24:35.263333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:24:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:24:35.269684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:35.270187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:35.270617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:35.271301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:35.271757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:35.272181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:35.336460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:35.344800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2de90c03-738f-4080-a06a-4697ec635e58 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088156 Sep 19 12:24:35.345360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1496/2955] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:35 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:36.368779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:36.369358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:36.371979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:36.377584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:36.378092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:36.378523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:36.379207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:36.379652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:36.380067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:36.442434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:36.450589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-612c454b-c995-44b9-946c-209ceb8dac6c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086342 Sep 19 12:24:36.451150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1460/2956] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:36 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:37.473847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:37.474416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:37.480706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:37.481187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:37.481623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:37.482357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:37.482809 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:37.483245 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:37.485791 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:37.545150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:37.553435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-493a6ce7-96bb-4925-a5c4-2b4aa029eabd tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083589 Sep 19 12:24:37.554566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1497/2957] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:37 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:38.576739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:38.577367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:38.583827 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:38.584304 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:38.584733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:38.585416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:38.585416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:38.586323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:38.647778 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:38.655966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-030d44c6-d5f1-4901-a69d-3ba615193f99 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083086 Sep 19 12:24:38.656522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1461/2958] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:38 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:39.680937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:39.681542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:39.688810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:39.689285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:39.689713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:39.690423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:39.690869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:39.691284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:39.756012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:39.766152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1b35d58-08cc-44b2-8b94-483ac888855e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089479 Sep 19 12:24:39.767109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1498/2959] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:39 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:40.792715 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:40.793340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:40.800015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:40.800493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:40.800924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:40.801604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:40.802088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:40.802512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:40.863450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:40.872333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f5e6f3c0-5816-40a2-a1b9-f3b0b3dc562e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084070 Sep 19 12:24:40.872903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1462/2960] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:40 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:41.895032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:41.895642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:41.898606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:41.906180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:41.907013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:41.907465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:41.908172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:41.908630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:41.909059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:41.970484 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:41.978775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02673cd9-c71f-48df-aa55-4443068a66f7 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087658 Sep 19 12:24:41.979331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1499/2961] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:41 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:43.004603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:43.005506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:43.016054 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:43.016774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:43.017446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:43.018514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:43.019200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:43.019856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:43.025963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=84 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:24:43.086988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:43.098537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c93a93a6-4c35-4e28-be69-d03c5db84a74 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.100371 Sep 19 12:24:43.099116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1463/2962] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:42 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:44.122961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:44.123620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:44.130187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:44.130666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:44.131119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:44.132275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:44.132722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:44.133138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:44.198851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:44.207192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45432a21-52bc-48f4-83df-af6a4f2a9824 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088063 Sep 19 12:24:44.207757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1500/2963] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:44 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:24:45.232249 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:45.233071 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:45.239476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:45.239958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:45.240396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:45.241152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:45.241748 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:45.242470 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:45.306767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:45.315445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d75f475-14cc-4fae-984b-5e1243e5b2e6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.087075 Sep 19 12:24:45.316029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1464/2964] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:45 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:46.339898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:46.340507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:46.347123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:46.347633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:46.348074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:46.348764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:46.349235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:46.349686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:46.420206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:46.432520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bd29f20-a77a-4921-b136-122ca9a3a9c1 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.096810 Sep 19 12:24:46.433390 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1501/2965] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:46 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:47.458292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:47.458888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:47.465703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:47.466234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:47.466686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:47.467420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:47.467878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:47.468309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:47.536420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:47.544918 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d63713d5-fe80-4a1d-8c6e-ecb73f9ee511 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090568 Sep 19 12:24:47.545505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1465/2966] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:47 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:48.569415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:48.570035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:48.576801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:48.577290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:48.577722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:48.578455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:48.578910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:48.579359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:48.645220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:48.654195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9dbc4fc6-6c06-46f2-8cda-738bf4d0b14d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089261 Sep 19 12:24:48.654744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1502/2967] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:48 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:49.676881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:49.677498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:49.684262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:49.684747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:49.685179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:49.685906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:49.686358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:49.686779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:49.755042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:49.763342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7ee925fc-77dd-479b-9a86-85de8cc2a465 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090376 Sep 19 12:24:49.763902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1466/2968] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:49 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:50.847659 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:50.848311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:50.855945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:50.856443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:50.856884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:50.857582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:50.858063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:50.858486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:50.920590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:50.929505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-044a203b-9534-444b-aba7-1fe9d5684dc5 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086058 Sep 19 12:24:50.930109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1503/2969] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:50 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:24:51.952777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:51.953377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:51.960395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:51.960880 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:51.961320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:51.962033 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:51.962734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:51.963157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:52.024407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:52.032598 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-08dd0b74-8ec4-4dfa-988a-05c65ffdcb28 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083731 Sep 19 12:24:52.033163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1467/2970] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:51 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:53.055610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:53.056215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:53.062674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:53.063155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:53.063586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:53.064274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:53.064725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:53.065145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:53.127369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:53.136128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d7845b3-a7bd-457e-852a-5e66b82b395d tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084330 Sep 19 12:24:53.136693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1504/2971] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:53 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:54.159495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:54.160109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:54.167290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:54.167777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:54.168212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:54.168928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:54.169397 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:54.169864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:54.230024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:54.238155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d616953e-0774-4bcb-bef0-6049b41e14ae tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082448 Sep 19 12:24:54.238711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1468/2972] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:54 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:55.260827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:55.261602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:55.268207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:55.268695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:55.269133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:55.269863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:55.270329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:55.270755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:55.334042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:55.342602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-966da9b1-926f-4bf6-9920-afa748624b9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085682 Sep 19 12:24:55.343170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1505/2973] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:55 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:24:56.366931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:56.367741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:56.374385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:56.374867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:56.375300 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:56.375992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:56.376442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:56.376867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:56.439081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:56.448096 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-25f34ccc-2277-4a31-a41f-d24b7cb83714 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085497 Sep 19 12:24:56.448692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1469/2974] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:56 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:57.471530 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:57.472098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:57.478486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:57.478959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:57.479393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:57.480071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:57.480514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:57.480934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:57.545085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:57.553350 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe08523d-2bde-467c-a51d-9c9bc00fd0a9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085649 Sep 19 12:24:57.554208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1506/2975] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:57 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:58.577675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:58.578347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:58.585241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:58.585736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:58.586217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:58.586946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:58.587678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:58.588107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:58.649277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:58.657674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-240dee03-a617-4f65-a242-0498af9eb911 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.084011 Sep 19 12:24:58.658282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1470/2976] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:58 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:24:59.681646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:24:59.682303 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:24:59.689561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:59.690081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:59.690512 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:59.691209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:24:59.691658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:24:59.692077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:24:59.757281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:24:59.765980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea3a1f3c-1d03-440b-b2b3-a79594178a76 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088902 Sep 19 12:24:59.766578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1507/2977] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:24:59 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:00.790973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:00.795514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:00.797927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:00.798412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:00.798847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:00.799540 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:00.799992 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:00.800410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:00.864007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:00.872731 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fdacced4-332d-4d40-a24d-7c31a4a236ea tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.086470 Sep 19 12:25:00.873315 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1471/2978] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:00 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:01.896043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:01.896621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:01.903253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:01.903735 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:01.904176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:01.904873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:01.905327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:01.905754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:01.972006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:01.980838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec72ccc4-bdf4-41d9-a3f1-0874d3244288 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088690 Sep 19 12:25:01.981424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1508/2979] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:01 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:03.010831 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:03.011704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:03.022493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:03.023386 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:03.024178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:03.025450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:03.026326 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:03.027070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:03.103646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:03.112526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-45b1628f-06f0-47e5-a4cf-2c8e6e030d1e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.109707 Sep 19 12:25:03.113116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1472/2980] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:03 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:04.137854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:04.138503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:04.145920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:04.146412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:04.146849 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:04.147552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:04.147999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:04.149006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:04.216761 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:04.225613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dad6ba30-623c-4fc4-997f-8a2d8c58ba86 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.091671 Sep 19 12:25:04.226234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1509/2981] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:04 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:05.253464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:05.254120 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:05.261633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:05.262194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:05.262625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:05.263323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:05.263823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:05.264323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:05.330354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:05.339678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f3a1ea34-0a88-4eb5-9d27-1001cbcc5404 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.090151 Sep 19 12:25:05.340280 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1473/2982] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:05 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:06.362818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:06.363435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:06.370045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:06.370540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:06.370970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:06.371683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:06.372119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:06.372537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:06.438444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:06.447111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf7d015e-8035-4cda-ab18-9bebbd334e27 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088211 Sep 19 12:25:06.447742 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1510/2983] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:06 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:07.471460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:07.472034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:07.474299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=28 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:07.480196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:07.480673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:07.481109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:07.481823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:07.482271 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:07.482687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:07.548341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:07.557550 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-df6452a5-c0e5-4d19-be1f-c0d8645ef553 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.089983 Sep 19 12:25:07.560368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1474/2984] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:07 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:08.580490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:08.581130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:08.583200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:25:08.583515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 (ip 10.222.0.88) !!! Sep 19 12:25:08.590133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:08.590615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:08.591045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:08.591738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:08.592189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:08.592645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:08.596230 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:08.656589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:08.664865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06216bac-438b-4fe4-a564-4e3af781a0f4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.088233 Sep 19 12:25:08.665434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1511/2985] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:08 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:09.688344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:09.688941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:09.695414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:09.695901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:09.696338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:09.697618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:09.698133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:09.698534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:09.758727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:09.767588 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a7816975-16f5-4594-b2a3-f8a13a9d5d08 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.083128 Sep 19 12:25:09.768164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1475/2986] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:09 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:10.791756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:10.792645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:10.798847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:10.799273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:10.799706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:10.800396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:10.800847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:10.801270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:10.864631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:10.873225 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76e74205-431a-4b5c-a819-6300bfe2da47 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.085892 Sep 19 12:25:10.874002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1512/2987] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:10 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:11.899926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:11.900538 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:11.907066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:11.907549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:11.907987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:11.908668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:11.909121 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:11.909548 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:11.970151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:11.978961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6fea44dc-564c-4782-ac7b-de636b6c3de8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 200 len: 1368 microversion: 2.1 time: 0.082958 Sep 19 12:25:11.979587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1476/2988] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:11 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:12.002767 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a1545f2-fa74-4fbc-b2f5-a5b81727a527 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '.version_select at 0x7f4ff6231940>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:12.012837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:12.025553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a1545f2-fa74-4fbc-b2f5-a5b81727a527 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333976459" status: 202 len: 0 microversion: 2.1 time: 0.026569 Sep 19 12:25:12.026223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1513/2989] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Sep 19 12:25:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1333976459 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:25:12.804683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:12.805182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:12.815608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:12.816407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:12.817090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:12.818085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:12.819017 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:12.819903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:12.865365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:25:12.949440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b60859d9-1c2c-44a7-a849-620bb90425b5 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 204 len: 0 microversion: 2.1 time: 0.149449 Sep 19 12:25:12.950272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1477/2990] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:25:12 2022] DELETE /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:25:12.958626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:12.959240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:12.960083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-827ea955-b7d5-4a6c-a032-a26137179107 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'create', calling method: .version_select at 0x7f4ff9985b80>, body: {"keypair": {"name": "tempest-keypair-720421820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJNiVp3pNZC9HxMdPAks1caTd0X6m4x4ItHbGunFjjWuDJlQF8ieCl7Ku7MSb56Rn/POXyFF+3gcRKyzqspALjywmEikGirjmcyfDPBa87uQjonwmq4ys33pOfivpxjUg=="}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:12.966661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:12.967153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:12.967803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:12.968771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:12.969109 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:12.969540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:12.976888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-827ea955-b7d5-4a6c-a032-a26137179107 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for project ec6875fa35a4462698c06020a0238285. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:25:12.980968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-827ea955-b7d5-4a6c-a032-a26137179107 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for user 8fa4b6af47384c7fb26aae3547d02b64 and project ec6875fa35a4462698c06020a0238285. Resources: {'key_pairs'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:25:13.010340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-827ea955-b7d5-4a6c-a032-a26137179107 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053894 Sep 19 12:25:13.010953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1478/2991] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:25:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:25:13.154773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:13.163255 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7abfaaf1-ff65-4f9b-bf36-8d65f110f5dd tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1506 microversion: 2.1 time: 0.208816 Sep 19 12:25:13.163756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1514/2992] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:12 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1506 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:14.186583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:14.187238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:14.193302 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:14.193812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:14.194260 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:14.194958 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:14.195414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:14.195852 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:14.201650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:14.336258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:14.346403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a05d660b-4f30-453f-9a7a-cf69a9617a99 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1506 microversion: 2.1 time: 0.164294 Sep 19 12:25:14.347605 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1479/2993] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:14 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:15.008322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4435c139-dc3b-435e-bda8-f6269c14396b req-69561b83-3825-46a8-b357-53bdaca59ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a51246d5-fe0a-4b24-a1d4-a580a28f16b2", "name": "network-vif-deleted", "tag": "14e39a91-db2d-4d93-8b16-dea6babf3281"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:15.020701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4435c139-dc3b-435e-bda8-f6269c14396b req-69561b83-3825-46a8-b357-53bdaca59ff7 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:15.021191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4435c139-dc3b-435e-bda8-f6269c14396b req-69561b83-3825-46a8-b357-53bdaca59ff7 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:15.021623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4435c139-dc3b-435e-bda8-f6269c14396b req-69561b83-3825-46a8-b357-53bdaca59ff7 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:15.036257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4435c139-dc3b-435e-bda8-f6269c14396b req-69561b83-3825-46a8-b357-53bdaca59ff7 service nova] Creating event network-vif-deleted:14e39a91-db2d-4d93-8b16-dea6babf3281 for instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 on hv-cinder-85829 Sep 19 12:25:15.048748 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4435c139-dc3b-435e-bda8-f6269c14396b req-69561b83-3825-46a8-b357-53bdaca59ff7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112872 Sep 19 12:25:15.049480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1515/2994] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:25:15.372274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:15.373038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:15.386765 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:15.387264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:15.387704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:15.388410 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:15.388863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:15.389288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:15.395811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-694440063", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54da1265-89c0-4c3d-9625-41afb5c2e57a"}], "security_groups": [{"name": "tempest-securitygroup--646753745"}], "key_name": "tempest-keypair-720421820", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:15.423947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:15.424434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:15.424867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:15.425308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lazy-loading 'fault' on Instance uuid c8301e0d-d1bf-432a-b68f-1692e5621b8f {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:25:15.471631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:15.479275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b9cb2c45-caf9-4a1c-bc34-13101f49ca33 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 200 len: 1310 microversion: 2.1 time: 0.113564 Sep 19 12:25:15.479856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1480/2995] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:15 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 1310 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:15.512920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] validate_networks() for [('54da1265-89c0-4c3d-9625-41afb5c2e57a', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:25:15.955519 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:25:15.955936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:25:15.956400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:25:15.956862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:25:15.957266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:25:15.966898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:15.967377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:15.967806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:15.968634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:15.969088 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:15.969508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:15.985882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for project ec6875fa35a4462698c06020a0238285. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:25:15.989861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Getting quotas for user 8fa4b6af47384c7fb26aae3547d02b64 and project ec6875fa35a4462698c06020a0238285. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:25:16.001290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:25:16.003708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:25:16.055378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cfda87ef-e18c-4802-a0e3-5353f3a62677 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.664100 Sep 19 12:25:16.056602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1516/2996] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:25:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:25:16.067966 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0d863e5a-78cf-4811-8456-59cfe4f2ff19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:16.068513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0d863e5a-78cf-4811-8456-59cfe4f2ff19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:16.125061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0d863e5a-78cf-4811-8456-59cfe4f2ff19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:16.132534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0d863e5a-78cf-4811-8456-59cfe4f2ff19 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1236 microversion: 2.1 time: 0.068713 Sep 19 12:25:16.133199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1481/2997] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:16 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:16.502852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:16.503583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: c8301e0d-d1bf-432a-b68f-1692e5621b8f] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:16.510017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:16.510676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:16.511215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:16.511995 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:16.512521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:16.513019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:16.528205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] HTTP exception thrown: Instance c8301e0d-d1bf-432a-b68f-1692e5621b8f could not be found. Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Request method failure captured: Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f HTTP/1.1 Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkzftjjoFvPkVIdmt_q2ZojFS3yvUWytkC41R4D0nbWIxVoZLDnG0zEE8dv7rMq9qDiofIsn_mcJI4tCBp3CvxSZCDS3AVWEmm5l75NvukVEvpBCmEidSCCYAgqp48zl0TtbgGJIdZT7b5-8Z6fJ32ElmxZj4lib-BhyWP0C8gklzE Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: bf7ef0ac87cb450f9320b8d3a313d942 Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:25:16.529895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bf7ef0ac87cb450f9320b8d3a313d942", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: bf7ef0ac87cb450f9320b8d3a313d942 Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-ServerRescueNegativeTestJSON-1616990579-project Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 11af9e7e3fed4bea9187dee0ebf27551 Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1616990579-project Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance c8301e0d-d1bf-432a-b68f-1692e5621b8f could not be found. Sep 19 12:25:16.531807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'c8301e0d-d1bf-432a-b68f-1692e5621b8f'} Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8301e0d-d1bf-432a-b68f-1692e5621b8f could not be found. Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:25:16.532860 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8301e0d-d1bf-432a-b68f-1692e5621b8f could not be found. Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8301e0d-d1bf-432a-b68f-1692e5621b8f could not be found. Sep 19 12:25:16.534637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:25:16.536181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Returning 404 to user: Instance c8301e0d-d1bf-432a-b68f-1692e5621b8f could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:25:16.536181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7cdd71b9-4d6e-4869-863e-f70e780b9900 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f" status: 404 len: 111 microversion: 2.1 time: 0.032441 Sep 19 12:25:16.536181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1517/2998] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:16 2022] GET /compute/v2.1/servers/c8301e0d-d1bf-432a-b68f-1692e5621b8f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:25:16.540030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:16.541016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:16.547842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:16.548332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:16.548772 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:16.549476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:16.550501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:16.550501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:16.578263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:25:16.661049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cd3d0325-fb2f-417c-8da0-22536f798127 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "DELETE /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 204 len: 0 microversion: 2.1 time: 0.124314 Sep 19 12:25:16.661823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1482/2999] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:25:16 2022] DELETE /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:25:16.670886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:16.671498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:16.677353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:16.677961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:16.678403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:16.679122 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:16.679579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:16.680196 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:16.816880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:16.825912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a55a342a-4bea-442b-8015-e4d8d23268b6 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1521 microversion: 2.1 time: 0.158977 Sep 19 12:25:16.826503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1518/3000] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:16 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:25:17.157649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:17.158383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:17.164274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:17.164759 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:17.165197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:17.165919 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:17.166379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:17.166806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:17.227995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:17.235563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7bb23a59-0f89-4066-8cda-78829b7f0c7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1288 microversion: 2.1 time: 0.082150 Sep 19 12:25:17.236127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1483/3001] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:17 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:17.296890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c59bd28f-db5b-41a0-938a-943cad58a7a3 req-c7831510-1ce6-4b8d-89ce-96323f64b187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8301e0d-d1bf-432a-b68f-1692e5621b8f", "name": "network-vif-deleted", "tag": "014d07ed-89c0-4c1c-ad81-4220f7049349"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:17.307757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c59bd28f-db5b-41a0-938a-943cad58a7a3 req-c7831510-1ce6-4b8d-89ce-96323f64b187 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:17.308630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c59bd28f-db5b-41a0-938a-943cad58a7a3 req-c7831510-1ce6-4b8d-89ce-96323f64b187 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:17.309161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c59bd28f-db5b-41a0-938a-943cad58a7a3 req-c7831510-1ce6-4b8d-89ce-96323f64b187 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:17.321086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c59bd28f-db5b-41a0-938a-943cad58a7a3 req-c7831510-1ce6-4b8d-89ce-96323f64b187 service nova] Creating event network-vif-deleted:014d07ed-89c0-4c1c-ad81-4220f7049349 for instance c8301e0d-d1bf-432a-b68f-1692e5621b8f on hv-cinder-85829 Sep 19 12:25:17.327302 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c59bd28f-db5b-41a0-938a-943cad58a7a3 req-c7831510-1ce6-4b8d-89ce-96323f64b187 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034572 Sep 19 12:25:17.328203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1519/3002] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:25:17.849355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:17.850564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:17.859075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:17.859849 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:17.860727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:17.861643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:17.862405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:17.862910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:17.936491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11af9e7e3fed4bea9187dee0ebf27551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf7ef0ac87cb450f9320b8d3a313d942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:17.946959 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57ddeef9-3888-44f0-85fe-11c637d52518 tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 200 len: 1479 microversion: 2.1 time: 0.100999 Sep 19 12:25:17.947615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1484/3003] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:17 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 1479 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:18.259114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:18.260070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:18.267704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:18.268332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:18.268830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:18.269595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:18.270130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:18.270757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:18.422355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:18.430260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72a2d937-2b79-41f9-b411-6e7a578e9e9f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1361 microversion: 2.1 time: 0.175116 Sep 19 12:25:18.430899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1520/3004] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:18 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:18.969824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:18.970448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] [instance: 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:18.976751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:18.977240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:18.977727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:18.978520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:18.978977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:18.979476 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:18.992489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] HTTP exception thrown: Instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 could not be found. Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Request method failure captured: Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 HTTP/1.1 Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFkzftjjoFvPkVIdmt_q2ZojFS3yvUWytkC41R4D0nbWIxVoZLDnG0zEE8dv7rMq9qDiofIsn_mcJI4tCBp3CvxSZCDS3AVWEmm5l75NvukVEvpBCmEidSCCYAgqp48zl0TtbgGJIdZT7b5-8Z6fJ32ElmxZj4lib-BhyWP0C8gklzE Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: bf7ef0ac87cb450f9320b8d3a313d942 Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:25:18.994677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/bf7ef0ac87cb450f9320b8d3a313d942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_bf7ef0ac87cb450f9320b8d3a313d942", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: bf7ef0ac87cb450f9320b8d3a313d942 Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1616990579 Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-ServerRescueNegativeTestJSON-1616990579-project Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 11af9e7e3fed4bea9187dee0ebf27551 Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1616990579-project Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 could not be found. Sep 19 12:25:18.996579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88'} Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 could not be found. Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:25:18.997666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 could not be found. Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 could not be found. Sep 19 12:25:18.999449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:25:19.001698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] Returning 404 to user: Instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:25:19.002577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-424ed5a2-50bc-483b-8436-7a5d3e5de85e tempest-ServerRescueNegativeTestJSON-1616990579 tempest-ServerRescueNegativeTestJSON-1616990579-project] 10.222.0.88 "GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88" status: 404 len: 111 microversion: 2.1 time: 0.036805 Sep 19 12:25:19.003261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1485/3005] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:18 2022] GET /compute/v2.1/servers/1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:25:19.350578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-383091bc-b4b1-49ec-801d-fedac9e689dc req-2a0346b8-c925-4e93-8df1-f4d0cba1fe2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88", "name": "network-vif-deleted", "tag": "60e4df69-30ab-4bd6-8f47-3dc96227847c"}, {"name": "network-changed", "server_uuid": "5dc4a960-d344-440a-846c-2e3bbe4d7d5c", "tag": "7858e970-3e4c-4905-bf24-17373f52a218"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:19.363757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-383091bc-b4b1-49ec-801d-fedac9e689dc req-2a0346b8-c925-4e93-8df1-f4d0cba1fe2f service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:19.364625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-383091bc-b4b1-49ec-801d-fedac9e689dc req-2a0346b8-c925-4e93-8df1-f4d0cba1fe2f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:19.365270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-383091bc-b4b1-49ec-801d-fedac9e689dc req-2a0346b8-c925-4e93-8df1-f4d0cba1fe2f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:19.381872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-383091bc-b4b1-49ec-801d-fedac9e689dc req-2a0346b8-c925-4e93-8df1-f4d0cba1fe2f service nova] Creating event network-vif-deleted:60e4df69-30ab-4bd6-8f47-3dc96227847c for instance 1126cd6b-5f12-4d6d-84b2-b1ef8c56ab88 on hv-cinder-85829 Sep 19 12:25:19.382624 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-383091bc-b4b1-49ec-801d-fedac9e689dc req-2a0346b8-c925-4e93-8df1-f4d0cba1fe2f service nova] Creating event network-changed:7858e970-3e4c-4905-bf24-17373f52a218 for instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c on hv-cinder-85829 Sep 19 12:25:19.390653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-383091bc-b4b1-49ec-801d-fedac9e689dc req-2a0346b8-c925-4e93-8df1-f4d0cba1fe2f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045637 Sep 19 12:25:19.392096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1521/3006] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:25:19.454258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:19.455163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:19.462681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:19.463878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:19.464689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:19.465648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:19.466367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:19.466888 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:19.908423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:19.916667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d3cdd953-8f8c-450a-9b7a-4f212061057f tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1361 microversion: 2.1 time: 0.465951 Sep 19 12:25:19.917441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1486/3007] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:19 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1361 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:20.943978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:20.944785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:20.952499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:20.953083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:20.953616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:20.954407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:20.954930 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:20.955492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:21.164815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:21.172858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-279bb96c-9bf4-456f-8d61-b3a5584b652e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1361 microversion: 2.1 time: 0.233044 Sep 19 12:25:21.173451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1522/3008] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:20 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:22.198621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:22.200299 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:22.210112 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:22.213164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:22.214736 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:22.215732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:22.216412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:22.217255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:22.491688 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:22.503901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a942afaa-dd58-411b-824f-f52f17029a07 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1361 microversion: 2.1 time: 0.310261 Sep 19 12:25:22.510612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1487/3009] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:22 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:23.528769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:23.529404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:23.537286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:23.537786 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:23.538277 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:23.538924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:23.539374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:23.539792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:23.671778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:23.679664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acaaa1b8-6fd4-478d-b26b-8302ade08dd6 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1361 microversion: 2.1 time: 0.155569 Sep 19 12:25:23.680326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1523/3010] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:23 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:23.785911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-66bf0211-0591-4c95-83c3-d36fa983b394 tempest-VolumesGetTestJSON-311651792 tempest-VolumesGetTestJSON-311651792-project] Action: 'create', calling method: .version_select at 0x7f4ff9a1f8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-110624356", "metadata": {"Type": "work"}}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:24.741636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-2fb827e9-9f00-486e-9f0b-44149b948b9e req-b33a641f-854e-4f8b-9468-1db15cbef9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc4a960-d344-440a-846c-2e3bbe4d7d5c", "name": "network-vif-plugged", "status": "completed", "tag": "7858e970-3e4c-4905-bf24-17373f52a218"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:24.751938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2fb827e9-9f00-486e-9f0b-44149b948b9e req-b33a641f-854e-4f8b-9468-1db15cbef9a1 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:24.752549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2fb827e9-9f00-486e-9f0b-44149b948b9e req-b33a641f-854e-4f8b-9468-1db15cbef9a1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:24.752974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2fb827e9-9f00-486e-9f0b-44149b948b9e req-b33a641f-854e-4f8b-9468-1db15cbef9a1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:24.765557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-2fb827e9-9f00-486e-9f0b-44149b948b9e req-b33a641f-854e-4f8b-9468-1db15cbef9a1 service nova] Creating event network-vif-plugged:7858e970-3e4c-4905-bf24-17373f52a218 for instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c on hv-cinder-85829 Sep 19 12:25:24.770436 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-2fb827e9-9f00-486e-9f0b-44149b948b9e req-b33a641f-854e-4f8b-9468-1db15cbef9a1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096573 Sep 19 12:25:24.771002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1524/3011] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:25:24.775775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:24.776456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:24.782422 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:24.782907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:24.783327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:24.784007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:24.784449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:24.784864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:24.931797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:24.940353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8efe7b75-ca69-4b36-8b80-4f0262555ce0 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1361 microversion: 2.1 time: 0.168240 Sep 19 12:25:24.940935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1525/3012] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:24 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:25:25.964279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:25.964867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:25.971420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:25.971904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:25.972331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:25.973017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:25.973456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:25.974842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:25.978901 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:25.996571 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:26.108315 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:26.115963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96ee2597-9682-4aa0-af88-49d3a605ecf4 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1361 microversion: 2.1 time: 0.155789 Sep 19 12:25:26.116556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1526/3013] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:25 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:25:26.129895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:27.140004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:27.140646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:27.147203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:27.147690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:27.148128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:27.148822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:27.149311 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:27.150298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:27.282181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:25:27.289670 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73a3796e-9fd6-4b43-8e9a-f305e3b98d4c tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1548 microversion: 2.1 time: 0.153518 Sep 19 12:25:27.290256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1527/3014] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:25:27 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:25:27.311938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:25:27.312421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:25:27.318208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:27.318685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:27.319116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:27.319792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:27.320237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:27.320661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:27.396314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8b01d27-2b47-4cb1-86b1-7471d79d2e7e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088031 Sep 19 12:25:27.396934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1528/3015] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Sep 19 12:25:27 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:25:28.590307 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-491b4291-5666-4321-9e6b-8a82454d2c33 req-2bfa9ff2-20b7-4e1b-87f9-e6fbba0e95cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc4a960-d344-440a-846c-2e3bbe4d7d5c", "tag": "7858e970-3e4c-4905-bf24-17373f52a218"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:25:28.600148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-491b4291-5666-4321-9e6b-8a82454d2c33 req-2bfa9ff2-20b7-4e1b-87f9-e6fbba0e95cd service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:25:28.600631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-491b4291-5666-4321-9e6b-8a82454d2c33 req-2bfa9ff2-20b7-4e1b-87f9-e6fbba0e95cd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:25:28.601058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-491b4291-5666-4321-9e6b-8a82454d2c33 req-2bfa9ff2-20b7-4e1b-87f9-e6fbba0e95cd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:25:28.613573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-491b4291-5666-4321-9e6b-8a82454d2c33 req-2bfa9ff2-20b7-4e1b-87f9-e6fbba0e95cd service nova] Creating event network-changed:7858e970-3e4c-4905-bf24-17373f52a218 for instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c on hv-cinder-85829 Sep 19 12:25:28.619358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-491b4291-5666-4321-9e6b-8a82454d2c33 req-2bfa9ff2-20b7-4e1b-87f9-e6fbba0e95cd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088196 Sep 19 12:25:28.619964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1529/3016] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:25:32.207931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:25:32.497207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:04.742441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:04.743328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=77 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:26:04.747564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:26:04.748162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:26:04.755348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:04.755824 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:04.756251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:04.756934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:26:04.757379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:26:04.757947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:26:04.783038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcecadf1-7f8d-46b2-bf92-981acebe4a84 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c/ips" status: 200 len: 147 microversion: 2.1 time: 0.042426 Sep 19 12:26:04.783612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1530/3017] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 12:26:04 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c/ips => generated 147 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:26:16.374524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:26:16.375025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:26:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.88) !!! Sep 19 12:27:04.858034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:04.858774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:27:04.863701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:04.864212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:04.871807 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.872288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.872722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.873441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.873910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.874333 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.899357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:27:04.977928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2db69e1e-0512-40ab-b434-683db9366155 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 204 len: 0 microversion: 2.1 time: 0.121263 Sep 19 12:27:04.978529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1531/3018] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:27:04 2022] DELETE /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:27:04.987776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:04.988471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:04.994504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.994988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.996096 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:04.996752 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:04.997202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:04.997623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:05.135384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:05.143290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eaaa43ae-86d5-4c4d-89e0-b90e37d53848 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1673 microversion: 2.1 time: 0.159615 Sep 19 12:27:05.143793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1532/3019] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:04 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:06.168065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:06.168684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:06.175378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:06.175861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:06.176290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:06.176988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:06.177457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:06.177892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:06.306417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:06.314961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef69b0a3-9ed9-4aa2-8ca8-d5e1b0b89fe8 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1673 microversion: 2.1 time: 0.151340 Sep 19 12:27:06.315529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1533/3020] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:06 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:27:07.308127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-53974c7a-a028-4139-a4d8-81b0b685c58d req-1cabdd61-3773-46ce-92d6-228ac80e0ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc4a960-d344-440a-846c-2e3bbe4d7d5c", "name": "network-vif-deleted", "tag": "7858e970-3e4c-4905-bf24-17373f52a218"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:27:07.318380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-53974c7a-a028-4139-a4d8-81b0b685c58d req-1cabdd61-3773-46ce-92d6-228ac80e0ab8 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:07.319473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-53974c7a-a028-4139-a4d8-81b0b685c58d req-1cabdd61-3773-46ce-92d6-228ac80e0ab8 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:07.320068 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-53974c7a-a028-4139-a4d8-81b0b685c58d req-1cabdd61-3773-46ce-92d6-228ac80e0ab8 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.331708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-53974c7a-a028-4139-a4d8-81b0b685c58d req-1cabdd61-3773-46ce-92d6-228ac80e0ab8 service nova] Creating event network-vif-deleted:7858e970-3e4c-4905-bf24-17373f52a218 for instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c on hv-cinder-85829 Sep 19 12:27:07.336679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-53974c7a-a028-4139-a4d8-81b0b685c58d req-1cabdd61-3773-46ce-92d6-228ac80e0ab8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032242 Sep 19 12:27:07.337784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1534/3021] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:27:07.345950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:07.346908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:07.353154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:07.353498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:07.353966 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.355263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:07.355723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:07.356148 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:07.426080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa4b6af47384c7fb26aae3547d02b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6875fa35a4462698c06020a0238285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:27:07.434074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea1a6aff-205d-4830-a623-3a205ead28e9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 200 len: 1321 microversion: 2.1 time: 0.092093 Sep 19 12:27:07.434795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1535/3022] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:07 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 1321 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:27:08.458318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:08.458972 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:08.465582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.466111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.466865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.468014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:08.468603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:08.469374 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:08.484696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] HTTP exception thrown: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Request method failure captured: Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c HTTP/1.1 Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkvQPkqFmgkiimvn1n-8T3cRfg6JI-6gXyItm0SB_UvSFHs0C6CRgD6zasfgg8ApfO51NhhDCV7ypSIv1eCBOnE5M751iY-T9yuZIMX_6myFw6A16BhkBaTQ8dT2SkJ0QpENuZPxvuHHmxC7iAMs_a73oBWbpUp-ix3VDPb40nv8zQ Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:27:08.486396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec6875fa35a4462698c06020a0238285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec6875fa35a4462698c06020a0238285", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 8fa4b6af47384c7fb26aae3547d02b64 Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:08.487847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '5dc4a960-d344-440a-846c-2e3bbe4d7d5c'} Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:08.488614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:08.489910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:08.491070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Returning 404 to user: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:08.491070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c5f8b65-c452-4cad-be22-b2bb056d1dab tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 404 len: 111 microversion: 2.1 time: 0.033533 Sep 19 12:27:08.491070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1536/3023] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:08 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:27:08.497266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21bdacbd-8708-4fac-9bb7-483cd2a41529 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '.version_select at 0x7f4ff5fdd310>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:08.516507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21bdacbd-8708-4fac-9bb7-483cd2a41529 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-720421820" status: 202 len: 0 microversion: 2.1 time: 0.023449 Sep 19 12:27:08.517060 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1537/3024] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Sep 19 12:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-720421820 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:27:09.126899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:09.127398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:09.133562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.134099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.134539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.135261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.136238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.136663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.150965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] HTTP exception thrown: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Request method failure captured: Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c HTTP/1.1 Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkvQPkqFmgkiimvn1n-8T3cRfg6JI-6gXyItm0SB_UvSFHs0C6CRgD6zasfgg8ApfO51NhhDCV7ypSIv1eCBOnE5M751iY-T9yuZIMX_6myFw6A16BhkBaTQ8dT2SkJ0QpENuZPxvuHHmxC7iAMs_a73oBWbpUp-ix3VDPb40nv8zQ Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:27:09.153331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec6875fa35a4462698c06020a0238285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec6875fa35a4462698c06020a0238285", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 8fa4b6af47384c7fb26aae3547d02b64 Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.154642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '5dc4a960-d344-440a-846c-2e3bbe4d7d5c'} Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:09.155455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.156722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.157955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Returning 404 to user: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:09.157955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56e27c86-e429-41ea-9f4c-ed94485e06c9 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "DELETE /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 404 len: 111 microversion: 2.1 time: 0.031781 Sep 19 12:27:09.157955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1538/3025] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:27:09 2022] DELETE /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:27:09.163029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:27:09.163634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 5dc4a960-d344-440a-846c-2e3bbe4d7d5c] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:27:09.169314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.169819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.170262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.170948 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:27:09.171403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:27:09.171827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:27:09.184870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] HTTP exception thrown: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Request method failure captured: Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c HTTP/1.1 Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkvQPkqFmgkiimvn1n-8T3cRfg6JI-6gXyItm0SB_UvSFHs0C6CRgD6zasfgg8ApfO51NhhDCV7ypSIv1eCBOnE5M751iY-T9yuZIMX_6myFw6A16BhkBaTQ8dT2SkJ0QpENuZPxvuHHmxC7iAMs_a73oBWbpUp-ix3VDPb40nv8zQ Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:27:09.186428 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec6875fa35a4462698c06020a0238285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec6875fa35a4462698c06020a0238285", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 8fa4b6af47384c7fb26aae3547d02b64 Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.187797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '5dc4a960-d344-440a-846c-2e3bbe4d7d5c'} Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:27:09.188631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. Sep 19 12:27:09.189953 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:27:09.191117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Returning 404 to user: Instance 5dc4a960-d344-440a-846c-2e3bbe4d7d5c could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:27:09.191117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c874ef8-a99f-41d4-9595-87b5af845d88 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c" status: 404 len: 111 microversion: 2.1 time: 0.028289 Sep 19 12:27:09.191117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1539/3026] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:27:09 2022] GET /compute/v2.1/servers/5dc4a960-d344-440a-846c-2e3bbe4d7d5c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:27:49.741847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:27:49.742432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.88) !!! Sep 19 12:28:16.374586 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:28:16.375165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:28:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.88) !!! Sep 19 12:29:14.634127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-66bf0211-0591-4c95-83c3-d36fa983b394 tempest-VolumesGetTestJSON-311651792 tempest-VolumesGetTestJSON-311651792-project] 10.222.0.88 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 230.959435 Sep 19 12:29:14.634771 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1488/3027] 10.222.0.88 () {60 vars in 1156 bytes} [Mon Sep 19 12:25:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 230961 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 19 12:31:13.620039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6028539e-503d-4f79-a154-8bd596e68640] AMQP server on 10.222.0.88:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 12:31:13.620883 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:13.621605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:31:13.622549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:31:13.622689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 (ip 10.222.0.88) !!! Sep 19 12:31:13.624100 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:31:13.624224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 (ip 10.222.0.88) !!! Sep 19 12:31:13.625229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:31:13.625334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 (ip 10.222.0.88) !!! Sep 19 12:31:13.630739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:13.631237 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:13.643069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.643553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.643986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.644739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.645195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.645942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.681038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:31:13.764098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-519e4b83-e3d0-4e90-9aa7-aef9734ca6a5 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 204 len: 0 microversion: 2.20 time: 0.145422 Sep 19 12:31:13.764955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1540/3028] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Sep 19 12:31:13 2022] DELETE /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:31:13.773097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef1fc493-fee7-4cfa-a593-3727931afed4] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 19 12:31:13.774527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:31:13.774667 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 (ip 10.222.0.88) !!! Sep 19 12:31:13.776502 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:31:13.776627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 (ip 10.222.0.88) !!! Sep 19 12:31:13.792740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:13.793435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:13.801150 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.801676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.802141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.802837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:13.803291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:13.803720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:13.937986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:13.946292 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:13.947720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:13.948879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ea27592a-fa56-4d41-a18c-02334734184a tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1724 microversion: 2.20 time: 0.179168 Sep 19 12:31:13.949434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1489/3029] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:31:13 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:31:14.975049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:14.975997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:14.987228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:14.987826 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:14.988347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:14.989097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:14.989555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:14.990015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:14.997090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] [6028539e-503d-4f79-a154-8bd596e68640] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54192. Sep 19 12:31:15.035847 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef1fc493-fee7-4cfa-a593-3727931afed4] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 54198. Sep 19 12:31:15.161903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:15.171356 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-a08da5a1-6f4c-440f-ab1c-35dddd1bb098 req-ba5cda81-898f-49e9-9030-0e2bf091052d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0801a648-e9e7-4bb2-bbb7-089d67aea513", "name": "network-vif-deleted", "tag": "bab6b572-93d2-47d2-afd3-38ffa91a825a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:31:15.175334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:15.177039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '766511b86ad643c099998fc4e1638f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256ccce56c534cacb247aa128399f3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:31:15.178501 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa141649-ec33-4ee7-9432-babf551c1849 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 200 len: 1656 microversion: 2.20 time: 0.208539 Sep 19 12:31:15.184700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-a08da5a1-6f4c-440f-ab1c-35dddd1bb098 req-ba5cda81-898f-49e9-9030-0e2bf091052d service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:15.185463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-a08da5a1-6f4c-440f-ab1c-35dddd1bb098 req-ba5cda81-898f-49e9-9030-0e2bf091052d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:15.186086 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-a08da5a1-6f4c-440f-ab1c-35dddd1bb098 req-ba5cda81-898f-49e9-9030-0e2bf091052d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:15.194274 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1541/3030] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:31:14 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 1656 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:31:15.225062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-a08da5a1-6f4c-440f-ab1c-35dddd1bb098 req-ba5cda81-898f-49e9-9030-0e2bf091052d service nova] Creating event network-vif-deleted:bab6b572-93d2-47d2-afd3-38ffa91a825a for instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 on hv-cinder-85829 Sep 19 12:31:15.243923 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-a08da5a1-6f4c-440f-ab1c-35dddd1bb098 req-ba5cda81-898f-49e9-9030-0e2bf091052d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227242 Sep 19 12:31:15.245091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1490/3031] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:31:16.274503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:16.275107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:31:16.281489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:16.282000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:16.282452 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:16.283126 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:31:16.283567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:31:16.283984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:31:16.297453 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] HTTP exception thrown: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Request method failure captured: Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 HTTP/1.1 Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk3Eot_6toYUfegJgeTOXPATnYn2wGZGn1PmyzNpYgplit4Qs_JRcRZAJ_ivvwOe4Rdvf7U0j47UFMMWg9ReOMOLaNsGufaenE9bKumdubXt76XclBEzSwPG1Da-z0s_uX6dx259JwJPobs6Dqr9HwJXc8kt_MQqNxJf7tplw-4SCg Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:31:16.299130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_256ccce56c534cacb247aa128399f3f1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 766511b86ad643c099998fc4e1638f9a Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:31:16.301082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '0801a648-e9e7-4bb2-bbb7-089d67aea513'} Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:31:16.301918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:31:16.303260 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:31:16.304362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Returning 404 to user: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:31:16.304362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98264922-118e-45be-b804-37e42d78352d tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 404 len: 111 microversion: 2.20 time: 0.030325 Sep 19 12:31:16.304362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1542/3032] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:31:16 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:31:16.310524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fb4768df-81d6-4d78-9c2e-aa37a5e3f2b8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '.version_select at 0x7f4ff9a1fc10>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:31:16.332574 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fb4768df-81d6-4d78-9c2e-aa37a5e3f2b8 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057299352" status: 204 len: 0 microversion: 2.20 time: 0.026419 Sep 19 12:31:16.333141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1491/3033] 10.222.0.88 () {60 vars in 1262 bytes} [Mon Sep 19 12:31:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057299352 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:32:08.452261 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:08.454455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:08.460455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:08.461499 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:08.463757 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:08.464247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:08.464817 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:08.465726 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:08.466454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:08.467151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:08.488623 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] HTTP exception thrown: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Request method failure captured: Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 HTTP/1.1 Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk3Eot_6toYUfegJgeTOXPATnYn2wGZGn1PmyzNpYgplit4Qs_JRcRZAJ_ivvwOe4Rdvf7U0j47UFMMWg9ReOMOLaNsGufaenE9bKumdubXt76XclBEzSwPG1Da-z0s_uX6dx259JwJPobs6Dqr9HwJXc8kt_MQqNxJf7tplw-4SCg Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:32:08.490498 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_256ccce56c534cacb247aa128399f3f1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 766511b86ad643c099998fc4e1638f9a Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.491813 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '0801a648-e9e7-4bb2-bbb7-089d67aea513'} Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:08.492474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.494656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Returning 404 to user: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:08.494656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14fa8ef7-343c-424f-9981-666f483de570 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "DELETE /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 404 len: 111 microversion: 2.20 time: 0.045047 Sep 19 12:32:08.494656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1543/3034] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Sep 19 12:32:08 2022] DELETE /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:32:08.499009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=8 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:08.499563 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:08.504483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:08.504859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: 0801a648-e9e7-4bb2-bbb7-089d67aea513] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:08.514662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:08.515375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:08.516109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:08.517824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:08.518531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:08.519565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:08.587107 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-79af2e8d-d1fe-4b01-96c2-57b3ce5095b1 req-721fc3ee-6564-4832-801b-f814534a90b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e8311d2-58be-42df-b177-55a98bebcb2e", "name": "network-vif-deleted", "tag": "77fc5477-7847-499d-a893-472333c63a06"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:08.617284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-79af2e8d-d1fe-4b01-96c2-57b3ce5095b1 req-721fc3ee-6564-4832-801b-f814534a90b8 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:08.618038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-79af2e8d-d1fe-4b01-96c2-57b3ce5095b1 req-721fc3ee-6564-4832-801b-f814534a90b8 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:08.618690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-79af2e8d-d1fe-4b01-96c2-57b3ce5095b1 req-721fc3ee-6564-4832-801b-f814534a90b8 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:08.634000 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-79af2e8d-d1fe-4b01-96c2-57b3ce5095b1 req-721fc3ee-6564-4832-801b-f814534a90b8 service nova] Creating event network-vif-deleted:77fc5477-7847-499d-a893-472333c63a06 for instance 6e8311d2-58be-42df-b177-55a98bebcb2e on hv-cinder-85829 Sep 19 12:32:08.640873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-79af2e8d-d1fe-4b01-96c2-57b3ce5095b1 req-721fc3ee-6564-4832-801b-f814534a90b8 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059506 Sep 19 12:32:08.642626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1544/3035] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:08.699412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] HTTP exception thrown: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Request method failure captured: Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 HTTP/1.1 Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFk3Eot_6toYUfegJgeTOXPATnYn2wGZGn1PmyzNpYgplit4Qs_JRcRZAJ_ivvwOe4Rdvf7U0j47UFMMWg9ReOMOLaNsGufaenE9bKumdubXt76XclBEzSwPG1Da-z0s_uX6dx259JwJPobs6Dqr9HwJXc8kt_MQqNxJf7tplw-4SCg Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:32:08.701331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_256ccce56c534cacb247aa128399f3f1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 766511b86ad643c099998fc4e1638f9a Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.702756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '0801a648-e9e7-4bb2-bbb7-089d67aea513'} Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:08.703405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. Sep 19 12:32:08.704442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:08.706698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Returning 404 to user: Instance 0801a648-e9e7-4bb2-bbb7-089d67aea513 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:08.706698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8c16b1e6-c2c4-437a-b826-e14ea6817206 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513" status: 404 len: 111 microversion: 2.20 time: 0.205960 Sep 19 12:32:08.706698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1492/3036] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:08 2022] GET /compute/v2.1/servers/0801a648-e9e7-4bb2-bbb7-089d67aea513 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:32:09.862601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:09.863272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:09.869711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:09.870233 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:09.870667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:09.871362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:09.871818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:09.872240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:09.886441 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] HTTP exception thrown: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Request method failure captured: Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 HTTP/1.1 Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFk3Eot_6toYUfegJgeTOXPATnYn2wGZGn1PmyzNpYgplit4Qs_JRcRZAJ_ivvwOe4Rdvf7U0j47UFMMWg9ReOMOLaNsGufaenE9bKumdubXt76XclBEzSwPG1Da-z0s_uX6dx259JwJPobs6Dqr9HwJXc8kt_MQqNxJf7tplw-4SCg Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:32:09.888132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_256ccce56c534cacb247aa128399f3f1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 766511b86ad643c099998fc4e1638f9a Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.889423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'a51246d5-fe0a-4b24-a1d4-a580a28f16b2'} Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:09.890342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.891545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.892738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Returning 404 to user: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:09.892738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88be9d0f-2b08-43e5-bd2a-981b97416fef tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "DELETE /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 404 len: 111 microversion: 2.20 time: 0.032408 Sep 19 12:32:09.892738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1545/3037] 10.222.0.88 () {60 vars in 1280 bytes} [Mon Sep 19 12:32:09 2022] DELETE /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:32:09.898105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:09.898743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] [instance: a51246d5-fe0a-4b24-a1d4-a580a28f16b2] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:09.904961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:09.905445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:09.905911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:09.906599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:09.907077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:09.907496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:09.920785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] HTTP exception thrown: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Request method failure captured: Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 HTTP/1.1 Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFk3Eot_6toYUfegJgeTOXPATnYn2wGZGn1PmyzNpYgplit4Qs_JRcRZAJ_ivvwOe4Rdvf7U0j47UFMMWg9ReOMOLaNsGufaenE9bKumdubXt76XclBEzSwPG1Da-z0s_uX6dx259JwJPobs6Dqr9HwJXc8kt_MQqNxJf7tplw-4SCg Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:32:09.922355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/256ccce56c534cacb247aa128399f3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_256ccce56c534cacb247aa128399f3f1", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 256ccce56c534cacb247aa128399f3f1 Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1255585087 Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 766511b86ad643c099998fc4e1638f9a Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1255585087-project Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.924400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'a51246d5-fe0a-4b24-a1d4-a580a28f16b2'} Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:09.925203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. Sep 19 12:32:09.926348 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:09.927284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] Returning 404 to user: Instance a51246d5-fe0a-4b24-a1d4-a580a28f16b2 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:09.927284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-811d53e0-10a3-40a4-9a4c-97dc88c655c2 tempest-AttachVolumeShelveTestJSON-1255585087 tempest-AttachVolumeShelveTestJSON-1255585087-project] 10.222.0.88 "GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2" status: 404 len: 111 microversion: 2.20 time: 0.029444 Sep 19 12:32:09.927284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1493/3038] 10.222.0.88 () {60 vars in 1277 bytes} [Mon Sep 19 12:32:09 2022] GET /compute/v2.1/servers/a51246d5-fe0a-4b24-a1d4-a580a28f16b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:32:19.522523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45074b13-d46c-43f0-88cf-30c0b535bb76 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: .version_select at 0x7f4ff64c5310>, body: {"keypair": {"name": "tempest-keypair-1068294436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxBk9R0mFDGlJp8QywSXcGKQIg0RtwxCw+5nYus7667Cr0Yl0Pu3EWOGFZhSVy3kiXTP42SEhZior7+zMCPlCVp2AqF3c8ICu1AAnHubDrw/+LO90dMD5TL5PMqTRDOxw=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:19.541622 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-45074b13-d46c-43f0-88cf-30c0b535bb76 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:19.546857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-45074b13-d46c-43f0-88cf-30c0b535bb76 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:19.585203 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45074b13-d46c-43f0-88cf-30c0b535bb76 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.335031 Sep 19 12:32:19.593843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1546/3039] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:32:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:21.483612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2136893543", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec1d8dc8-9672-46f8-8c41-7f866e0c00cf"}], "security_groups": [{"name": "tempest-securitygroup--2010143113"}], "key_name": "tempest-keypair-1068294436", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:21.494259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:21.494746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:21.593559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] validate_networks() for [('ec1d8dc8-9672-46f8-8c41-7f866e0c00cf', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:32:22.023991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:32:22.024420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:32:22.024897 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:32:22.025308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:32:22.025718 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:32:22.035388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.035697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.036132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.037037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.037684 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.038145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.057690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:22.061666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:22.073616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:32:22.076060 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:32:22.130843 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fcd78b47-634d-467c-b8a7-fb854c831980 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.651474 Sep 19 12:32:22.132039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1494/3040] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:32:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:32:22.140663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:22.147460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-648164e7-002d-4a2c-a25c-bb5a521d3f1a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:22.149369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-648164e7-002d-4a2c-a25c-bb5a521d3f1a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:22.216835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-648164e7-002d-4a2c-a25c-bb5a521d3f1a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:22.226050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-648164e7-002d-4a2c-a25c-bb5a521d3f1a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1242 microversion: 2.1 time: 0.086903 Sep 19 12:32:22.227282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1547/3041] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:22 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:22.465870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-935579908", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "networks": [{"uuid": "d6e39ea9-4dd9-4061-a6fd-555e7f2ff5a0"}]}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:22.526270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] validate_networks() for [('d6e39ea9-4dd9-4061-a6fd-555e7f2ff5a0', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:32:22.923499 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:32:22.923973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:32:22.924475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:32:22.925076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:32:22.925528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:32:22.937998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.938489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.939479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.940215 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:22.940687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:22.941103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:22.960554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Getting quotas for project 4c2ce53e7c5a4ccfb823e3873501b42d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:22.965392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Getting quotas for user 64ae73c1701343b284fe92b4b4226a3b and project 4c2ce53e7c5a4ccfb823e3873501b42d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:22.976874 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:32:22.979090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:32:23.032972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-19b63547-e3fc-497c-9a37-8452ac9d2afe tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572548 Sep 19 12:32:23.034241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1495/3042] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:32:23.054551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4fb7405-e564-4987-bb0e-40f43dec7c08 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:23.055666 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4fb7405-e564-4987-bb0e-40f43dec7c08 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:23.123002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4fb7405-e564-4987-bb0e-40f43dec7c08 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:23.133297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4fb7405-e564-4987-bb0e-40f43dec7c08 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1213 microversion: 2.1 time: 0.091736 Sep 19 12:32:23.147602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1548/3043] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:23 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:23.248829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:23.249656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:23.256906 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:23.257395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:23.257864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:23.258560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:23.259007 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:23.259428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:23.327845 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:23.337395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2a75d9cc-8f52-4c01-8cf5-2b139a9b7ca8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1294 microversion: 2.1 time: 0.092382 Sep 19 12:32:23.338758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1496/3044] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:23 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:24.157412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:24.158578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:24.166133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:24.166819 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:24.167455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:24.168591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:24.169373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:24.169977 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:24.265360 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:24.278176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27100807-a3b7-47a0-9dd8-d0621e331a16 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1265 microversion: 2.1 time: 0.124996 Sep 19 12:32:24.279081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1549/3045] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:24 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:24.363078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:24.363850 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:24.371478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:24.372247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:24.372941 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:24.381552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:24.382758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:24.383609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:24.546270 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:24.555182 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-49cbb2f7-7997-4081-a7aa-bbc43e5c5a8d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.197165 Sep 19 12:32:24.555865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1497/3046] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:24 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:25.301187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:25.301835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:25.308785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.309135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.309736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.310521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.310981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.311406 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.445528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:25.453223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f82cb66-d2ec-45c2-91ef-b632a3d262a4 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.156099 Sep 19 12:32:25.453814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1550/3047] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:25 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:25.524233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-942ca0a4-90d3-4244-bf6f-3a76e25ba1b4 req-9b5b49b1-d020-48b5-a8e1-a3475aaa3549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4013ca3a-af58-4992-a620-6089699f6c35", "tag": "c6905042-d423-484b-aa2f-bff15b552f57"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:25.537751 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-942ca0a4-90d3-4244-bf6f-3a76e25ba1b4 req-9b5b49b1-d020-48b5-a8e1-a3475aaa3549 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.538488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-942ca0a4-90d3-4244-bf6f-3a76e25ba1b4 req-9b5b49b1-d020-48b5-a8e1-a3475aaa3549 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.539089 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-942ca0a4-90d3-4244-bf6f-3a76e25ba1b4 req-9b5b49b1-d020-48b5-a8e1-a3475aaa3549 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.552505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-942ca0a4-90d3-4244-bf6f-3a76e25ba1b4 req-9b5b49b1-d020-48b5-a8e1-a3475aaa3549 service nova] Creating event network-changed:c6905042-d423-484b-aa2f-bff15b552f57 for instance 4013ca3a-af58-4992-a620-6089699f6c35 on hv-cinder-85829 Sep 19 12:32:25.562403 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-942ca0a4-90d3-4244-bf6f-3a76e25ba1b4 req-9b5b49b1-d020-48b5-a8e1-a3475aaa3549 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039842 Sep 19 12:32:25.563309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1498/3048] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:25.578765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:25.579993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:25.586539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.587123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.587776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.588486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:25.588942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:25.589369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:25.727281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:25.735039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94ac93d3-37df-4a0b-b84d-678f7e12d83b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.160109 Sep 19 12:32:25.735599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1551/3049] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:25 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:26.477518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:26.478321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:26.484701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:26.485207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:26.486309 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:26.487014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:26.487471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:26.487910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:26.623454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:26.631314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d9217e7f-6639-4fda-8a3c-60cc25da33dd tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.158030 Sep 19 12:32:26.631865 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1499/3050] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:26 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:26.760343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:26.760940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:26.767838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:26.768358 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:26.768785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:26.769465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:26.769971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:26.770389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:26.898400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:26.905955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec52f2f4-79f2-49dd-bb54-03609cbddce1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.149411 Sep 19 12:32:26.906515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1552/3051] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:26 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:27.582935 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-299d3315-2edb-43dd-8dfc-4100c17c15b8 req-a71bb20e-0f2f-495d-9d5a-f51fad341342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c26d4c6-233b-40fe-a92c-f34cc6cd0dec", "tag": "cd78947a-006e-4cd3-99ae-830714ea4b6f"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:27.592952 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-299d3315-2edb-43dd-8dfc-4100c17c15b8 req-a71bb20e-0f2f-495d-9d5a-f51fad341342 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.593423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-299d3315-2edb-43dd-8dfc-4100c17c15b8 req-a71bb20e-0f2f-495d-9d5a-f51fad341342 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.593867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-299d3315-2edb-43dd-8dfc-4100c17c15b8 req-a71bb20e-0f2f-495d-9d5a-f51fad341342 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.604824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-299d3315-2edb-43dd-8dfc-4100c17c15b8 req-a71bb20e-0f2f-495d-9d5a-f51fad341342 service nova] Creating event network-changed:cd78947a-006e-4cd3-99ae-830714ea4b6f for instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec on hv-cinder-85829 Sep 19 12:32:27.609630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-299d3315-2edb-43dd-8dfc-4100c17c15b8 req-a71bb20e-0f2f-495d-9d5a-f51fad341342 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030729 Sep 19 12:32:27.610252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1500/3052] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:27.653513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:27.654227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:27.661553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.662400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.663185 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.664164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.664684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.665063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.805667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:27.814433 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-064c299d-5bd1-4c94-9dee-d0a688eb3619 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.164188 Sep 19 12:32:27.815415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1553/3053] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:27 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:27.930097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:27.930699 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:27.936785 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.937261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.937691 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:27.938425 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:27.938904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:27.939321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:28.065642 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:28.073188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-3378709f-5fda-4dee-8de7-9249860bb224 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.147453 Sep 19 12:32:28.073744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1501/3054] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:27 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:28.837974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:28.838796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:28.844820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:28.845296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:28.845724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:28.846661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:28.847266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:28.847686 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:28.994861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:29.003473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5302315-8c64-415f-a392-0c3000817017 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.169635 Sep 19 12:32:29.004048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1554/3055] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:28 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:29.095913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:29.096524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:29.102884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:29.103370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:29.104368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:29.105066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:29.105524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:29.105989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:29.239685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:29.247560 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-18cd5950-9c80-48e3-bd00-e9dc3e34e858 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.155559 Sep 19 12:32:29.248126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1502/3056] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:29 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:30.025918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:30.026521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:30.033564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.034055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.034483 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.035189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.035633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.036050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.162049 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:30.169680 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64d8c040-52fe-4f08-b107-04d2633b1997 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.147571 Sep 19 12:32:30.170273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1555/3057] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:30 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:30.272924 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:30.273531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:30.279927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.280354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.280791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.281484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:30.281979 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:30.282407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:30.411734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:30.419920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e6393770-883f-4124-b49a-61213092e069 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.150764 Sep 19 12:32:30.420493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1503/3058] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:30 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:31.193747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:31.194669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:31.201100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:31.201733 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:31.202330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:31.203893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:31.205028 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:31.205453 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:31.227550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-137ceaf1-368a-4d59-9f75-f1566f06eb8b req-0d690cd5-310e-4c6f-bdcc-2ef5eec39274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4013ca3a-af58-4992-a620-6089699f6c35", "name": "network-vif-plugged", "status": "completed", "tag": "c6905042-d423-484b-aa2f-bff15b552f57"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:31.239764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-137ceaf1-368a-4d59-9f75-f1566f06eb8b req-0d690cd5-310e-4c6f-bdcc-2ef5eec39274 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:31.240465 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-137ceaf1-368a-4d59-9f75-f1566f06eb8b req-0d690cd5-310e-4c6f-bdcc-2ef5eec39274 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:31.240892 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-137ceaf1-368a-4d59-9f75-f1566f06eb8b req-0d690cd5-310e-4c6f-bdcc-2ef5eec39274 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:31.258346 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-137ceaf1-368a-4d59-9f75-f1566f06eb8b req-0d690cd5-310e-4c6f-bdcc-2ef5eec39274 service nova] Creating event network-vif-plugged:c6905042-d423-484b-aa2f-bff15b552f57 for instance 4013ca3a-af58-4992-a620-6089699f6c35 on hv-cinder-85829 Sep 19 12:32:31.265257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-137ceaf1-368a-4d59-9f75-f1566f06eb8b req-0d690cd5-310e-4c6f-bdcc-2ef5eec39274 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162779 Sep 19 12:32:31.265868 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1556/3059] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:31.339744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:31.348822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f31f3d6e-4e60-45e3-865a-efc483a156f9 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.160027 Sep 19 12:32:31.349572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1504/3060] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:31 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:32:31.443359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:31.444129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:31.450435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:31.450913 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:31.451378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:31.452132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:31.452507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:31.452923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:31.589290 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:31.598085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba738006-a946-4dec-b48e-7ce19c5f1ab1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.159062 Sep 19 12:32:31.598581 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1557/3061] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:31 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:32.372650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:32.373263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:32.379879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:32.380367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:32.380807 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:32.381533 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:32.382021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:32.382452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:32.620605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:32.621210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:32.627865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:32.628283 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:32.628715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:32.629410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:32.629890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:32.630336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:32.743034 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:32.752001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7e25fdbb-cd99-4de9-85c6-5dd7c8101e60 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.383104 Sep 19 12:32:32.752591 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1505/3062] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:32 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:32.927702 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:32.935615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7dfce29e-0879-40ad-9869-5d1e7fdfd145 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1368 microversion: 2.1 time: 0.318896 Sep 19 12:32:32.936413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1558/3063] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:32 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:32:33.280534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-73378dbe-b68a-4290-92aa-b363587b362b req-c8191f79-2a33-4219-a092-eb4ac8d2c23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c26d4c6-233b-40fe-a92c-f34cc6cd0dec", "name": "network-vif-plugged", "status": "completed", "tag": "cd78947a-006e-4cd3-99ae-830714ea4b6f"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:33.285332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:33.286076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=12 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:33.292376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-73378dbe-b68a-4290-92aa-b363587b362b req-c8191f79-2a33-4219-a092-eb4ac8d2c23b service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.292851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-73378dbe-b68a-4290-92aa-b363587b362b req-c8191f79-2a33-4219-a092-eb4ac8d2c23b service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.293281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-73378dbe-b68a-4290-92aa-b363587b362b req-c8191f79-2a33-4219-a092-eb4ac8d2c23b service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.305723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-73378dbe-b68a-4290-92aa-b363587b362b req-c8191f79-2a33-4219-a092-eb4ac8d2c23b service nova] Creating event network-vif-plugged:cd78947a-006e-4cd3-99ae-830714ea4b6f for instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec on hv-cinder-85829 Sep 19 12:32:33.310791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-73378dbe-b68a-4290-92aa-b363587b362b req-c8191f79-2a33-4219-a092-eb4ac8d2c23b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034010 Sep 19 12:32:33.311990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1506/3064] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:33.776949 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:33.777557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:33.779776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=8 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:33.785641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.786161 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.786588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.787267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.787710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.788124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.921961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:33.932330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a446e3c-e55b-4d89-b4db-d3fdeb550cfa tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1313 microversion: 2.1 time: 0.159932 Sep 19 12:32:33.932916 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1559/3065] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:33 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:33.958564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:33.959258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:33.966144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.966625 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.967062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:33.967746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:33.968196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:33.968621 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:34.099021 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:34.106671 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4b840cbc-f54e-45b9-b907-e287b19c0d66 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1558 microversion: 2.1 time: 0.152264 Sep 19 12:32:34.107230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1507/3066] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:33 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:34.129509 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:34.130127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:34.136066 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:34.136614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:34.137056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:34.137743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:34.138204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:34.138625 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:34.216451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e13ddd53-8abe-4870-a8f1-aae0e462f483 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090718 Sep 19 12:32:34.217062 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1560/3067] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Sep 19 12:32:34 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:34.956511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:34.957114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:34.963687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:34.964297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:34.965006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:34.965268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:34.965721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:34.966173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.189418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:35.198062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-32d694f2-dc8a-45c9-97a1-8c3a68c9029e tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1496 microversion: 2.1 time: 0.245971 Sep 19 12:32:35.198929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1508/3068] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:34 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1496 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:32:35.270847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4296b019-4f8f-4b66-b570-2a8e5aa61f8c req-a254d35f-0d9e-4465-8e06-56ff1aa26d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4013ca3a-af58-4992-a620-6089699f6c35", "tag": "c6905042-d423-484b-aa2f-bff15b552f57"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:35.282874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4296b019-4f8f-4b66-b570-2a8e5aa61f8c req-a254d35f-0d9e-4465-8e06-56ff1aa26d72 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:35.283437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4296b019-4f8f-4b66-b570-2a8e5aa61f8c req-a254d35f-0d9e-4465-8e06-56ff1aa26d72 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:35.283933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4296b019-4f8f-4b66-b570-2a8e5aa61f8c req-a254d35f-0d9e-4465-8e06-56ff1aa26d72 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.295890 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4296b019-4f8f-4b66-b570-2a8e5aa61f8c req-a254d35f-0d9e-4465-8e06-56ff1aa26d72 service nova] Creating event network-changed:c6905042-d423-484b-aa2f-bff15b552f57 for instance 4013ca3a-af58-4992-a620-6089699f6c35 on hv-cinder-85829 Sep 19 12:32:35.301887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4296b019-4f8f-4b66-b570-2a8e5aa61f8c req-a254d35f-0d9e-4465-8e06-56ff1aa26d72 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097258 Sep 19 12:32:35.302800 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1561/3069] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:35.643124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:35.643913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:35.651712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:35.652306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:35.652820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.653609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:35.654174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:35.654672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.682763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:32:35.771948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-babbb84c-eac9-44c4-977e-6b243ae2891d tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "DELETE /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 204 len: 0 microversion: 2.1 time: 0.131968 Sep 19 12:32:35.772658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1509/3070] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:32:35 2022] DELETE /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:32:35.783007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:35.783784 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:35.793174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:35.793656 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:35.794116 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.794804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:35.795247 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:35.795665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:35.930086 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:35.937863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6daf652a-44fb-4993-803b-3e8c6c62a8a2 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1502 microversion: 2.1 time: 0.160449 Sep 19 12:32:35.938460 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1562/3071] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:35 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:36.961557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:36.962285 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:36.968630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:36.969107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:36.970068 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:36.970753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:36.971205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:36.971626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:37.104430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:37.112879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-565ff7a9-0d17-46d2-8577-1867660a09a8 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 200 len: 1502 microversion: 2.1 time: 0.155824 Sep 19 12:32:37.113459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1510/3072] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:36 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:32:37.552999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-3412524a-1f55-43c8-9464-7d247f9621dd req-02a49d57-1d93-4a05-9303-942cb104a092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c26d4c6-233b-40fe-a92c-f34cc6cd0dec", "name": "network-vif-deleted", "tag": "cd78947a-006e-4cd3-99ae-830714ea4b6f"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:37.566645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3412524a-1f55-43c8-9464-7d247f9621dd req-02a49d57-1d93-4a05-9303-942cb104a092 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:37.567132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3412524a-1f55-43c8-9464-7d247f9621dd req-02a49d57-1d93-4a05-9303-942cb104a092 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:37.567565 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3412524a-1f55-43c8-9464-7d247f9621dd req-02a49d57-1d93-4a05-9303-942cb104a092 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:37.579857 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-3412524a-1f55-43c8-9464-7d247f9621dd req-02a49d57-1d93-4a05-9303-942cb104a092 service nova] Creating event network-vif-deleted:cd78947a-006e-4cd3-99ae-830714ea4b6f for instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec on hv-cinder-85829 Sep 19 12:32:37.586569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-3412524a-1f55-43c8-9464-7d247f9621dd req-02a49d57-1d93-4a05-9303-942cb104a092 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036970 Sep 19 12:32:37.587154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1563/3073] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:38.135961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:38.136558 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:38.143191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:38.143677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:38.144099 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:38.144787 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:38.145234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:38.145660 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:38.158749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] HTTP exception thrown: Instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec could not be found. Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Request method failure captured: Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec HTTP/1.1 Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFUGZcyPvUF8kpEB9QllpxVmHgpTsUxH3KC7rhaB7_x4A9C6MG5YtwNpVm5bHEZWlo2_Apda36DmYYtZ6DOYNwO6QGz71JhURIITDRBGLvBWXw8UoALrHvrcfjSWYiy768qN_9NXy5F5m-c9tyOvjjFstPT849wVPnOU_eEVQ4ZyBM Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 4c2ce53e7c5a4ccfb823e3873501b42d Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesActionsTest-1721724282 Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:32:38.160414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4c2ce53e7c5a4ccfb823e3873501b42d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4c2ce53e7c5a4ccfb823e3873501b42d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4c2ce53e7c5a4ccfb823e3873501b42d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4c2ce53e7c5a4ccfb823e3873501b42d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesActionsTest-1721724282 Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 4c2ce53e7c5a4ccfb823e3873501b42d Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesActionsTest-1721724282 Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesActionsTest-1721724282-project Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 64ae73c1701343b284fe92b4b4226a3b Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesActionsTest-1721724282-project Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec could not be found. Sep 19 12:32:38.161701 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '2c26d4c6-233b-40fe-a92c-f34cc6cd0dec'} Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec could not be found. Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:38.162396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec could not be found. Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec could not be found. Sep 19 12:32:38.163495 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:38.164440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Returning 404 to user: Instance 2c26d4c6-233b-40fe-a92c-f34cc6cd0dec could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:38.164440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6878b264-f680-4082-bcc0-cc605c3f0420 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec" status: 404 len: 111 microversion: 2.1 time: 0.029741 Sep 19 12:32:38.164440 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1511/3074] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:38 2022] GET /compute/v2.1/servers/2c26d4c6-233b-40fe-a92c-f34cc6cd0dec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:32:38.211983 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1634310407", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "networks": [{"uuid": "d6e39ea9-4dd9-4061-a6fd-555e7f2ff5a0"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:38.263783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] validate_networks() for [('d6e39ea9-4dd9-4061-a6fd-555e7f2ff5a0', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:32:38.654457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:32:38.655071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:32:38.655364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:32:38.655769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:32:38.656175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:32:38.658775 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:38.667386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:38.667864 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:38.668292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:38.669008 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:38.669459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:38.669914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:38.686713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Getting quotas for project 4c2ce53e7c5a4ccfb823e3873501b42d. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:32:38.690716 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Getting quotas for user 64ae73c1701343b284fe92b4b4226a3b and project 4c2ce53e7c5a4ccfb823e3873501b42d. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:32:38.701648 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:32:38.704488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:32:38.752166 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b02a1fc-882f-4229-bb21-9a2752295077 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544525 Sep 19 12:32:38.752843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1564/3075] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:32:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:32:38.763929 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d92c4e8-0804-49ec-a342-588b50182ab7 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:38.764578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d92c4e8-0804-49ec-a342-588b50182ab7 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:38.819695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d92c4e8-0804-49ec-a342-588b50182ab7 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:38.826693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d92c4e8-0804-49ec-a342-588b50182ab7 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1214 microversion: 2.1 time: 0.066672 Sep 19 12:32:38.827257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1512/3076] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:38 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:39.850652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:39.851271 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:39.859554 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:39.860937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:39.861545 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:39.862403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:39.862866 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:39.863297 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:39.924628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:39.932256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-248787db-391a-4b86-8a8e-8b2bc05e9755 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1272 microversion: 2.1 time: 0.085941 Sep 19 12:32:39.932822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1565/3077] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:39 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:40.955846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:40.956487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:40.964102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:40.964597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:40.965039 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:40.965742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:40.966228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:40.966658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:41.009121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-17529423-1931-4583-8b20-7c83692ebce8 req-40740f1c-c8fa-420b-bea7-caf6b1c1f85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d6bac1-2b6b-467c-8269-f775a0d0b7d9", "tag": "ea42c191-af00-401c-9795-d16f98daf9be"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:41.022417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-17529423-1931-4583-8b20-7c83692ebce8 req-40740f1c-c8fa-420b-bea7-caf6b1c1f85c service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:41.023151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-17529423-1931-4583-8b20-7c83692ebce8 req-40740f1c-c8fa-420b-bea7-caf6b1c1f85c service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:41.023760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-17529423-1931-4583-8b20-7c83692ebce8 req-40740f1c-c8fa-420b-bea7-caf6b1c1f85c service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:41.040017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-17529423-1931-4583-8b20-7c83692ebce8 req-40740f1c-c8fa-420b-bea7-caf6b1c1f85c service nova] Creating event network-changed:ea42c191-af00-401c-9795-d16f98daf9be for instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 on hv-cinder-85829 Sep 19 12:32:41.045157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-17529423-1931-4583-8b20-7c83692ebce8 req-40740f1c-c8fa-420b-bea7-caf6b1c1f85c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040332 Sep 19 12:32:41.046389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1566/3078] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:32:41.104472 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:41.108321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:41.113991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0e20cf2f-5925-421a-891b-b6e87e2ae7ca tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1314 microversion: 2.1 time: 0.162603 Sep 19 12:32:41.114561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1513/3079] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:40 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:42.137564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:42.138246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:42.146056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:42.146613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:42.146982 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:42.147679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:42.148131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:42.148831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:42.281267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:42.288837 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-285ebbd2-32c2-492f-91fa-a3a45cfeb21c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1314 microversion: 2.1 time: 0.155513 Sep 19 12:32:42.289402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1567/3080] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:42 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:43.310884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:43.311526 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:43.319580 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.320067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.320589 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.321647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:43.322406 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:43.323134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:43.454375 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:43.462193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e68f697c-134b-4078-afb0-d30eefd55e01 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1314 microversion: 2.1 time: 0.155147 Sep 19 12:32:43.462763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1514/3081] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:43 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:44.485635 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:44.486168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:44.492604 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.493074 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.493526 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.494242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:44.494693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:44.495106 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:44.625029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:44.633025 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e58e720b-07eb-4471-b6be-93177dbac35c tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1314 microversion: 2.1 time: 0.152196 Sep 19 12:32:44.633674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1568/3082] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:44 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:45.655212 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:45.655820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:45.661866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:45.662355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:45.662789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:45.663474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:45.663926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:45.664347 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:45.792077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:45.800370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af68289f-2ed5-45f2-85b1-676c07205541 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1314 microversion: 2.1 time: 0.149140 Sep 19 12:32:45.801317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1515/3083] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:45 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:46.824473 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:46.825071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:46.831487 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:46.831961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:46.832387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:46.833065 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:46.833505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:46.833950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:46.838135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:46.966641 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:46.977191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be8718c0-bba3-4b68-8b66-25f4261825ec tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1314 microversion: 2.1 time: 0.156726 Sep 19 12:32:46.977773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1569/3084] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:46 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:47.037977 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-eab3c801-59b3-42de-aa70-97814ebc824d req-8dd2c388-e52e-4175-ac74-ef9b72fa4c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d6bac1-2b6b-467c-8269-f775a0d0b7d9", "name": "network-vif-plugged", "status": "completed", "tag": "ea42c191-af00-401c-9795-d16f98daf9be"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:47.049174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-eab3c801-59b3-42de-aa70-97814ebc824d req-8dd2c388-e52e-4175-ac74-ef9b72fa4c84 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:47.049674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-eab3c801-59b3-42de-aa70-97814ebc824d req-8dd2c388-e52e-4175-ac74-ef9b72fa4c84 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:47.050138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-eab3c801-59b3-42de-aa70-97814ebc824d req-8dd2c388-e52e-4175-ac74-ef9b72fa4c84 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:47.061741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-eab3c801-59b3-42de-aa70-97814ebc824d req-8dd2c388-e52e-4175-ac74-ef9b72fa4c84 service nova] Creating event network-vif-plugged:ea42c191-af00-401c-9795-d16f98daf9be for instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 on hv-cinder-85829 Sep 19 12:32:47.067583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-eab3c801-59b3-42de-aa70-97814ebc824d req-8dd2c388-e52e-4175-ac74-ef9b72fa4c84 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 Sep 19 12:32:47.068183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1516/3085] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:48.000377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:48.000987 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:48.007399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:48.007884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:48.008326 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:48.009014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:48.009470 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:48.009928 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:48.138889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:48.147153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58d6827e-54b6-4eec-bc65-355c42b71cef tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1314 microversion: 2.1 time: 0.150616 Sep 19 12:32:48.147747 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1570/3086] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:47 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:49.167325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:49.171473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:49.172822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:49.179123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.179609 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.180043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:49.180727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.181208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.181631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:49.308822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:49.316392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7015df89-edeb-4873-a4e0-34187af3a3ea tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1497 microversion: 2.1 time: 0.150499 Sep 19 12:32:49.316956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1517/3087] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:49 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:49.758722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:49.759216 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:49.760967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:49.761638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:49.769443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.769959 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.770388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:49.771090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.771534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.771951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:49.796423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:32:49.872137 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b986909-0ab8-4508-ba4c-e29266f12267 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "DELETE /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 204 len: 0 microversion: 2.1 time: 0.116937 Sep 19 12:32:49.872778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1571/3088] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:32:49 2022] DELETE /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:32:49.881676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:49.882324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:49.888123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.888646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.889078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:49.889780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:49.890231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:49.890651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:50.022723 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:50.030321 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-cc5ff473-1fec-46a8-b963-596f43516e33 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1503 microversion: 2.1 time: 0.152609 Sep 19 12:32:50.030892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1518/3089] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:49 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:51.053851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:51.054547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:51.061258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:51.061740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:51.062197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:51.063495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:51.063945 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:51.064362 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:51.191843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:51.199457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-931b5cf9-b557-4b22-9426-a71515570717 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1503 microversion: 2.1 time: 0.150008 Sep 19 12:32:51.200015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1572/3090] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:51 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:51.940551 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-f253ac8e-054b-42f0-af15-094d6d7fc2b1 req-18c850fd-adb7-4085-8250-f832b2583334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d6bac1-2b6b-467c-8269-f775a0d0b7d9", "name": "network-vif-deleted", "tag": "ea42c191-af00-401c-9795-d16f98daf9be"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:32:51.946878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:32:51.953399 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f253ac8e-054b-42f0-af15-094d6d7fc2b1 req-18c850fd-adb7-4085-8250-f832b2583334 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:51.954543 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f253ac8e-054b-42f0-af15-094d6d7fc2b1 req-18c850fd-adb7-4085-8250-f832b2583334 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:51.954997 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f253ac8e-054b-42f0-af15-094d6d7fc2b1 req-18c850fd-adb7-4085-8250-f832b2583334 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:51.967821 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-f253ac8e-054b-42f0-af15-094d6d7fc2b1 req-18c850fd-adb7-4085-8250-f832b2583334 service nova] Creating event network-vif-deleted:ea42c191-af00-401c-9795-d16f98daf9be for instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 on hv-cinder-85829 Sep 19 12:32:51.972991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-f253ac8e-054b-42f0-af15-094d6d7fc2b1 req-18c850fd-adb7-4085-8250-f832b2583334 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Sep 19 12:32:51.973593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1519/3091] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:32:52.221609 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:52.222184 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:52.228481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:52.228964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:52.229404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:52.230125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:52.230580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:52.231011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:52.263155 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:52.263630 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:52.264063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:52.264497 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lazy-loading 'fault' on Instance uuid d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:32:52.306541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64ae73c1701343b284fe92b4b4226a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c2ce53e7c5a4ccfb823e3873501b42d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:32:52.314690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf5d1ad6-ee24-4c41-92a1-e4273cd4df90 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 200 len: 1304 microversion: 2.1 time: 0.096955 Sep 19 12:32:52.315252 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1573/3092] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:52 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:32:53.338612 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:32:53.339314 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] [instance: d9d6bac1-2b6b-467c-8269-f775a0d0b7d9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:32:53.345444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:53.345910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:53.346357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:53.347048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:32:53.347505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:32:53.347931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:32:53.360901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] HTTP exception thrown: Instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 could not be found. Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Request method failure captured: Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 HTTP/1.1 Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFUGZcyPvUF8kpEB9QllpxVmHgpTsUxH3KC7rhaB7_x4A9C6MG5YtwNpVm5bHEZWlo2_Apda36DmYYtZ6DOYNwO6QGz71JhURIITDRBGLvBWXw8UoALrHvrcfjSWYiy768qN_9NXy5F5m-c9tyOvjjFstPT849wVPnOU_eEVQ4ZyBM Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 4c2ce53e7c5a4ccfb823e3873501b42d Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-VolumesActionsTest-1721724282 Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:32:53.362531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4c2ce53e7c5a4ccfb823e3873501b42d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/4c2ce53e7c5a4ccfb823e3873501b42d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/4c2ce53e7c5a4ccfb823e3873501b42d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_4c2ce53e7c5a4ccfb823e3873501b42d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-VolumesActionsTest-1721724282 Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 4c2ce53e7c5a4ccfb823e3873501b42d Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-VolumesActionsTest-1721724282 Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-VolumesActionsTest-1721724282-project Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 64ae73c1701343b284fe92b4b4226a3b Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-VolumesActionsTest-1721724282-project Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 could not be found. Sep 19 12:32:53.363945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'd9d6bac1-2b6b-467c-8269-f775a0d0b7d9'} Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 could not be found. Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:32:53.364739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 could not be found. Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 could not be found. Sep 19 12:32:53.366088 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:32:53.367145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] Returning 404 to user: Instance d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:32:53.367145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8e75518b-529d-4238-934c-d3d2213f01e5 tempest-VolumesActionsTest-1721724282 tempest-VolumesActionsTest-1721724282-project] 10.222.0.88 "GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9" status: 404 len: 111 microversion: 2.1 time: 0.030411 Sep 19 12:32:53.367145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1520/3093] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:32:53 2022] GET /compute/v2.1/servers/d9d6bac1-2b6b-467c-8269-f775a0d0b7d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:11.475328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:11.475886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:11.494669 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:11.497588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:11.507728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:11.508579 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:11.509128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:11.509967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:11.510548 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:11.511226 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:11.541858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e619d3fb-25b1-4b7c-8c71-45796797c140 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/ips" status: 200 len: 150 microversion: 2.1 time: 0.071541 Sep 19 12:33:11.542672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1574/3094] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 12:33:11 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/ips => generated 150 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:33:13.009590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e26c8c64-f167-43e3-b0ce-c9eeea941a1c"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:13.011994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:13.015110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:13.015890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=30 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:13.022714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:13.023198 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:13.023631 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:13.024322 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:13.024773 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:13.025200 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:13.259522 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-16e0617e-a0e5-435d-a1a0-7d6db25edff4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253750 Sep 19 12:33:13.260442 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1521/3095] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:33:13 2022] POST /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:14.438685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:14.439210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:14.445664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:14.446183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:14.446616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:14.447299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:14.447749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:14.448172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:14.461525 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] HTTP exception thrown: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Request method failure captured: Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 HTTP/1.1 Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKFkvQPkqFmgkiimvn1n-8T3cRfg6JI-6gXyItm0SB_UvSFHs0C6CRgD6zasfgg8ApfO51NhhDCV7ypSIv1eCBOnE5M751iY-T9yuZIMX_6myFw6A16BhkBaTQ8dT2SkJ0QpENuZPxvuHHmxC7iAMs_a73oBWbpUp-ix3VDPb40nv8zQ Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:33:14.463197 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec6875fa35a4462698c06020a0238285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec6875fa35a4462698c06020a0238285", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: 8fa4b6af47384c7fb26aae3547d02b64 Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.464703 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '9ad06da9-6475-4fc6-a5f2-a98250348a27'} Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:14.465511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.466808 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.468253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Returning 404 to user: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:14.468253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b17f256a-47cf-4ce2-8f68-c8d08a23e96e tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 404 len: 111 microversion: 2.1 time: 0.029977 Sep 19 12:33:14.468253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1575/3096] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:33:14 2022] DELETE /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:14.474753 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:14.475459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] [instance: 9ad06da9-6475-4fc6-a5f2-a98250348a27] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:14.481639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:14.482136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:14.482578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:14.483269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:14.483724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:14.484177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:14.499333 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] HTTP exception thrown: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Request method failure captured: Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 HTTP/1.1 Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKFkvQPkqFmgkiimvn1n-8T3cRfg6JI-6gXyItm0SB_UvSFHs0C6CRgD6zasfgg8ApfO51NhhDCV7ypSIv1eCBOnE5M751iY-T9yuZIMX_6myFw6A16BhkBaTQ8dT2SkJ0QpENuZPxvuHHmxC7iAMs_a73oBWbpUp-ix3VDPb40nv8zQ Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:33:14.500944 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/ec6875fa35a4462698c06020a0238285"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/ec6875fa35a4462698c06020a0238285"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_ec6875fa35a4462698c06020a0238285", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: ec6875fa35a4462698c06020a0238285 Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeTestJSON-633401818 Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 8fa4b6af47384c7fb26aae3547d02b64 Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeTestJSON-633401818-project Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.502409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '9ad06da9-6475-4fc6-a5f2-a98250348a27'} Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:33:14.503141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. Sep 19 12:33:14.504398 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:33:14.505559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] Returning 404 to user: Instance 9ad06da9-6475-4fc6-a5f2-a98250348a27 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:33:14.505559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9fb8158b-39b1-40a5-bb89-cbe2b15e7528 tempest-AttachVolumeTestJSON-633401818 tempest-AttachVolumeTestJSON-633401818-project] 10.222.0.88 "GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27" status: 404 len: 111 microversion: 2.1 time: 0.032359 Sep 19 12:33:14.505559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1522/3097] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:14 2022] GET /compute/v2.1/servers/9ad06da9-6475-4fc6-a5f2-a98250348a27 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:33:23.049998 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-764088d1-4ec4-497c-8ea7-b82acb6e838f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: .version_select at 0x7f4ff5ff1040>, body: {"keypair": {"name": "tempest-keypair-1265513286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWyMZCE+9bk/j42qX0lJi+eTI2jaq/jyFWykyCeL5pjCta++RT10lTmT4GZl85OKiC9ceC871F24Hbksj8UvbDKNmFEQsfhgoCJJ+/Ur8nNDRSgnJi3omv7oR65rJwLag=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:23.067480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-764088d1-4ec4-497c-8ea7-b82acb6e838f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:33:23.071626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-764088d1-4ec4-497c-8ea7-b82acb6e838f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:33:23.095009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-764088d1-4ec4-497c-8ea7-b82acb6e838f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050443 Sep 19 12:33:23.095599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1576/3098] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:33:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:24.368902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1012190018", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec1d8dc8-9672-46f8-8c41-7f866e0c00cf"}], "security_groups": [{"name": "tempest-securitygroup--1725246114"}], "key_name": "tempest-keypair-1265513286", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:24.472168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] validate_networks() for [('ec1d8dc8-9672-46f8-8c41-7f866e0c00cf', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:33:24.489139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:24.831436 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:33:24.831861 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:33:24.832364 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:33:24.832774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:33:24.833186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:33:24.842163 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:24.842645 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:24.843083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:24.844628 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:24.845087 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:24.845512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:24.862562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:33:24.866468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:33:24.877310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:33:24.879614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:33:24.927626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-43a83b23-70c6-4e4e-a8a5-923959a34178 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563044 Sep 19 12:33:24.928289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1523/3099] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:33:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:33:24.939410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0df61dcd-5eb0-4b78-ade0-7ccfd4bdce12 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:24.940026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0df61dcd-5eb0-4b78-ade0-7ccfd4bdce12 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:24.943818 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:24.998724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0df61dcd-5eb0-4b78-ade0-7ccfd4bdce12 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:25.005721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0df61dcd-5eb0-4b78-ade0-7ccfd4bdce12 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1242 microversion: 2.1 time: 0.070273 Sep 19 12:33:25.006424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1577/3100] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:24 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:26.028636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:26.029307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:26.036076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:26.036676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:26.037022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:26.037729 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:26.038247 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:26.038725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:26.112209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:26.120199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1b9c1522-a70d-43e7-bf11-4b2d2f0fa42a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1238 microversion: 2.1 time: 0.095885 Sep 19 12:33:26.120830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1524/3101] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:26 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1238 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:27.144463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:27.145073 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:27.151493 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:27.151976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:27.152414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:27.153105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:27.153555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:27.154013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:27.215475 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:27.223044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da1a3e67-93eb-4250-9964-74ae78a3b35e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1294 microversion: 2.1 time: 0.083023 Sep 19 12:33:27.223603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1578/3102] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:27 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:28.245894 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:28.246562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:28.252889 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:28.253396 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:28.253876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:28.254561 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:28.255010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:28.255432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:28.317289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:28.324986 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-939d67ca-206f-4959-9059-a5bbb8d76b1f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1294 microversion: 2.1 time: 0.082989 Sep 19 12:33:28.325477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1525/3103] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:28 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:29.348546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:29.349165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:29.356253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:29.356746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:29.357186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:29.357914 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:29.358552 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:29.359528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:29.432869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:29.440567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3358f3ee-9df5-4d46-b6f1-03367ff85d6d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1300 microversion: 2.1 time: 0.095779 Sep 19 12:33:29.441135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1579/3104] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:29 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:30.465623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:30.466268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:30.472532 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:30.473015 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:30.473450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:30.474165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:30.474619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:30.475038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:30.603650 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:30.612075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-e126e429-1f0f-49d6-8c4b-657a9ecf46d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.150232 Sep 19 12:33:30.612636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1526/3105] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:30 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:31.345067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-fd1af2df-19c5-43e5-9798-ced2b66eb4df req-fd2fd6e2-fefd-47a8-b461-ac5ceeb65812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cf3654a-8922-41bf-ac33-580481e66074", "tag": "81bf526f-d01a-47db-a7eb-2412c49156d4"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:31.355125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fd1af2df-19c5-43e5-9798-ced2b66eb4df req-fd2fd6e2-fefd-47a8-b461-ac5ceeb65812 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.355601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fd1af2df-19c5-43e5-9798-ced2b66eb4df req-fd2fd6e2-fefd-47a8-b461-ac5ceeb65812 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.356035 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fd1af2df-19c5-43e5-9798-ced2b66eb4df req-fd2fd6e2-fefd-47a8-b461-ac5ceeb65812 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.366636 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-fd1af2df-19c5-43e5-9798-ced2b66eb4df req-fd2fd6e2-fefd-47a8-b461-ac5ceeb65812 service nova] Creating event network-changed:81bf526f-d01a-47db-a7eb-2412c49156d4 for instance 9cf3654a-8922-41bf-ac33-580481e66074 on hv-cinder-85829 Sep 19 12:33:31.371682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-fd1af2df-19c5-43e5-9798-ced2b66eb4df req-fd2fd6e2-fefd-47a8-b461-ac5ceeb65812 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030908 Sep 19 12:33:31.372258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1580/3106] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:33:31.635579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:31.636266 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:31.643567 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.643984 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.644523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.645206 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:31.645662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:31.646117 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:31.778186 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:31.786704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f2d4e6fd-614e-48bf-a6cc-07e406e5f3a4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.155043 Sep 19 12:33:31.787278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1527/3107] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:31 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:32.810697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:32.811480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:32.817590 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:32.818113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:32.818546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:32.822132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:32.822725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:32.823278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:32.969889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:32.978152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-406a5844-3f52-4c40-9099-cae118931054 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.172057 Sep 19 12:33:32.979067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1581/3108] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:32 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:34.002105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:34.002719 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:34.009235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:34.009725 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:34.010189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:34.010911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:34.011368 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:34.011799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:34.157079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:34.164709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ad7a2b2c-9185-4e5b-8f21-fc7a48354589 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.167037 Sep 19 12:33:34.165307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1528/3109] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:33 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:35.189246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:35.189907 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:35.192430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:35.197750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:35.198293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:35.198733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:35.199633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:35.200195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:35.200760 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:35.353135 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:35.362300 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f919a640-639c-4d89-9427-0afedf44807a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.177605 Sep 19 12:33:35.362872 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1582/3110] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:35 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:36.384655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:36.385477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:36.387480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:36.388189 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:33:36.395708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:36.396204 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:36.396635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:36.397329 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:36.397801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:36.398228 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:36.536646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:36.545374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ba7de4f8-850a-4191-adac-abe37f58cd58 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.164574 Sep 19 12:33:36.545989 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1529/3111] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:36 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:37.571693 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:37.572228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:37.579391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:37.579956 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:37.580647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:37.581419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:37.582342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:37.583036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:37.796798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:37.805070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d26f1eee-c83e-4bab-ab70-de2fd9a54d71 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.239953 Sep 19 12:33:37.806327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1583/3112] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:37 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:33:37.831421 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-0481bdc2-9559-4573-be36-c4e851755f51 req-b896bea1-050f-4881-9590-2cbbe28f5d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf3654a-8922-41bf-ac33-580481e66074", "name": "network-vif-plugged", "status": "completed", "tag": "81bf526f-d01a-47db-a7eb-2412c49156d4"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:37.848149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-0481bdc2-9559-4573-be36-c4e851755f51 req-b896bea1-050f-4881-9590-2cbbe28f5d6a service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:37.848917 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-0481bdc2-9559-4573-be36-c4e851755f51 req-b896bea1-050f-4881-9590-2cbbe28f5d6a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:37.849498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-0481bdc2-9559-4573-be36-c4e851755f51 req-b896bea1-050f-4881-9590-2cbbe28f5d6a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:37.863664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-0481bdc2-9559-4573-be36-c4e851755f51 req-b896bea1-050f-4881-9590-2cbbe28f5d6a service nova] Creating event network-vif-plugged:81bf526f-d01a-47db-a7eb-2412c49156d4 for instance 9cf3654a-8922-41bf-ac33-580481e66074 on hv-cinder-85829 Sep 19 12:33:37.870460 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-0481bdc2-9559-4573-be36-c4e851755f51 req-b896bea1-050f-4881-9590-2cbbe28f5d6a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043269 Sep 19 12:33:37.871679 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1530/3113] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:38.829246 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:38.829992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:38.837034 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:38.837541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:38.838011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:38.838718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:38.839171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:38.839598 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:38.982444 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:38.990059 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6a06c9f-d20d-40e3-b980-e2113872e101 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1368 microversion: 2.1 time: 0.165325 Sep 19 12:33:38.990608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1584/3114] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:38 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:40.013395 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:40.014116 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:40.020184 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:40.020658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:40.021144 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:40.021755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:40.022218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:40.022634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:40.155137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:33:40.164029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-35928d73-2b47-47e0-9609-427c01560800 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1558 microversion: 2.1 time: 0.155265 Sep 19 12:33:40.164617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1531/3115] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:33:40 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:33:40.186884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:33:40.187414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:33:40.193714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:40.194165 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:40.194596 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:40.195275 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:40.195719 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:40.196140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:40.275770 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41cd7189-fca7-434f-8c78-0c4448619bea tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092797 Sep 19 12:33:40.276384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1585/3116] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Sep 19 12:33:40 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:33:41.447293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-c25ef5fb-7080-46b4-9b54-12af862570d6 req-37c6ab29-92af-4c12-a91a-1f5cacd9e5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cf3654a-8922-41bf-ac33-580481e66074", "tag": "81bf526f-d01a-47db-a7eb-2412c49156d4"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:33:41.462481 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c25ef5fb-7080-46b4-9b54-12af862570d6 req-37c6ab29-92af-4c12-a91a-1f5cacd9e5fe service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:33:41.463063 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c25ef5fb-7080-46b4-9b54-12af862570d6 req-37c6ab29-92af-4c12-a91a-1f5cacd9e5fe service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:33:41.463614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c25ef5fb-7080-46b4-9b54-12af862570d6 req-37c6ab29-92af-4c12-a91a-1f5cacd9e5fe service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:33:41.476226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-c25ef5fb-7080-46b4-9b54-12af862570d6 req-37c6ab29-92af-4c12-a91a-1f5cacd9e5fe service nova] Creating event network-changed:81bf526f-d01a-47db-a7eb-2412c49156d4 for instance 9cf3654a-8922-41bf-ac33-580481e66074 on hv-cinder-85829 Sep 19 12:33:41.481983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-c25ef5fb-7080-46b4-9b54-12af862570d6 req-37c6ab29-92af-4c12-a91a-1f5cacd9e5fe service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038413 Sep 19 12:33:41.482793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1532/3117] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:16.376337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:16.377926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=42 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:16.382665 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:16.383383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:16.395496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:16.396013 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:16.396459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.397192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:16.397650 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:16.398425 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.435158 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69b5a77e-6ac0-4055-a6f2-2a9ab8c35635 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074/ips" status: 200 len: 150 microversion: 2.1 time: 0.060194 Sep 19 12:34:16.436262 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1586/3118] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 12:34:16 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:16.446682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:16.447415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=48 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:16.451830 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e26c8c64-f167-43e3-b0ce-c9eeea941a1c"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:16.454506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:16.464662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:16.466579 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:16.467261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.468282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:16.469067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:16.469231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.853559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Invalid volume: volume e26c8c64-f167-43e3-b0ce-c9eeea941a1c is already attached to instances: 4013ca3a-af58-4992-a620-6089699f6c35 Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: POST /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074/os-volume_attachments HTTP/1.1 Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 74 Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:34:16.855075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {"volumeAttachment": {"volumeId": "e26c8c64-f167-43e3-b0ce-c9eeea941a1c"}} Sep 19 12:34:16.857210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Invalid volume: volume e26c8c64-f167-43e3-b0ce-c9eeea941a1c is already attached to instances: 4013ca3a-af58-4992-a620-6089699f6c35 Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '9cf3654a-8922-41bf-ac33-580481e66074', 'body': {'volumeAttachment': {'volumeId': 'e26c8c64-f167-43e3-b0ce-c9eeea941a1c'}}} Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e26c8c64-f167-43e3-b0ce-c9eeea941a1c is already attached to instances: 4013ca3a-af58-4992-a620-6089699f6c35 Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:16.858623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e26c8c64-f167-43e3-b0ce-c9eeea941a1c is already attached to instances: 4013ca3a-af58-4992-a620-6089699f6c35 Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:16.860864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:16.862343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:16.862343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:34:16.862343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:34:16.862343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e26c8c64-f167-43e3-b0ce-c9eeea941a1c is already attached to instances: 4013ca3a-af58-4992-a620-6089699f6c35 Sep 19 12:34:16.862343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:16.862343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 400 to user: Invalid volume: volume e26c8c64-f167-43e3-b0ce-c9eeea941a1c is already attached to instances: 4013ca3a-af58-4992-a620-6089699f6c35 {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:34:16.862343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-89be1b48-58f1-48c7-8548-1150f63a8770 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.413617 Sep 19 12:34:16.863599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1533/3119] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:34:16 2022] POST /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074/os-volume_attachments => generated 174 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:34:16.885631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:16.887925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:16.895296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:16.896004 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:16.896633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.897517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:16.898157 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:16.898739 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:16.934055 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:34:17.116562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f38bd3d7-7d1f-4c3d-a5c2-12d360f0c0c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 204 len: 0 microversion: 2.1 time: 0.247303 Sep 19 12:34:17.119773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1587/3120] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:34:16 2022] DELETE /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:34:17.128152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:17.129114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:17.146863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:17.147724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:17.148373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:17.149306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:17.150707 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:17.151230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:17.326010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:17.335032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-27c625d3-3613-4fd1-b7b4-5958b324aacf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1683 microversion: 2.1 time: 0.211154 Sep 19 12:34:17.336313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1534/3121] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:17 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:18.364080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:18.364895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:18.376927 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:18.377427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:18.377906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:18.378821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:18.379468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:18.380051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:18.576053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:18.585859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe94db4e-1e53-4077-9cfc-78ff52f8377f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1683 microversion: 2.1 time: 0.227099 Sep 19 12:34:18.587558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1588/3122] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:18 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1683 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:19.612916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:19.614345 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:19.621059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:19.621811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:19.622483 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:19.623409 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:19.624072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:19.624724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:19.697987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:19.708215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4e0d0efb-ac7b-4e7f-bb8c-3e1d7fa285a3 req-dfc9a4bd-9f72-4cfa-b68c-4c57a7fa2e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf3654a-8922-41bf-ac33-580481e66074", "name": "network-vif-deleted", "tag": "81bf526f-d01a-47db-a7eb-2412c49156d4"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:19.709724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-96e5ed28-92aa-4739-81ee-21429119bee9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 200 len: 1615 microversion: 2.1 time: 0.101049 Sep 19 12:34:19.726367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1535/3123] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:19 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:19.729377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e0d0efb-ac7b-4e7f-bb8c-3e1d7fa285a3 req-dfc9a4bd-9f72-4cfa-b68c-4c57a7fa2e5b service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:19.730334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e0d0efb-ac7b-4e7f-bb8c-3e1d7fa285a3 req-dfc9a4bd-9f72-4cfa-b68c-4c57a7fa2e5b service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:19.731147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4e0d0efb-ac7b-4e7f-bb8c-3e1d7fa285a3 req-dfc9a4bd-9f72-4cfa-b68c-4c57a7fa2e5b service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:19.745832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4e0d0efb-ac7b-4e7f-bb8c-3e1d7fa285a3 req-dfc9a4bd-9f72-4cfa-b68c-4c57a7fa2e5b service nova] Creating event network-vif-deleted:81bf526f-d01a-47db-a7eb-2412c49156d4 for instance 9cf3654a-8922-41bf-ac33-580481e66074 on hv-cinder-85829 Sep 19 12:34:19.751951 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4e0d0efb-ac7b-4e7f-bb8c-3e1d7fa285a3 req-dfc9a4bd-9f72-4cfa-b68c-4c57a7fa2e5b service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048470 Sep 19 12:34:19.752740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1589/3124] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:34:20.735915 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:20.737156 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:20.745402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:20.746173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:20.746754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:20.747637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:20.748250 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:20.748676 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:20.763557 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 HTTP/1.1 Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:34:20.765379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:34:20.766976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '9cf3654a-8922-41bf-ac33-580481e66074'} Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:34:20.767876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:34:20.769081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:34:20.770230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:34:20.771547 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ba56d804-8366-4d8b-a466-07b54b1626dc tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 404 len: 111 microversion: 2.1 time: 0.037993 Sep 19 12:34:20.772207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1536/3125] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:20 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:34:20.783480 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ab2bb5c-dc18-42c8-928c-c7b06cf8a61f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '.version_select at 0x7f4ff6e5d040>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:20.809419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ab2bb5c-dc18-42c8-928c-c7b06cf8a61f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265513286" status: 202 len: 0 microversion: 2.1 time: 0.032027 Sep 19 12:34:20.810588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1590/3126] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Sep 19 12:34:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1265513286 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:34:21.614856 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:21.615415 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:21.622109 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:21.622594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:21.623029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:21.623720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:21.624172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:21.624985 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:21.720434 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lazy-loading 'services' on Instance uuid 4013ca3a-af58-4992-a620-6089699f6c35 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:34:21.805575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fa033ba9-68de-4bcb-9386-0265088143c6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments/e26c8c64-f167-43e3-b0ce-c9eeea941a1c" status: 202 len: 0 microversion: 2.1 time: 0.195107 Sep 19 12:34:21.806521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1537/3127] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:34:21 2022] DELETE /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments/e26c8c64-f167-43e3-b0ce-c9eeea941a1c => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:34:21.828182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:21.844043 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:21.865720 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:21.868878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:21.869569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:21.872553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:21.873112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:21.873531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:21.920178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72ff8d3e-36d2-43b2-a673-0491e23129c1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109353 Sep 19 12:34:21.921287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1591/3128] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:34:21 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:22.936127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:22.939097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:22.946750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:22.947248 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:22.947686 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:22.948400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:22.948901 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:22.949331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:22.979443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d35e0c45-7344-4f43-9210-926bb8254808 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049735 Sep 19 12:34:22.980004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1538/3129] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:34:22 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:34:22.984990 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-299ccfd2-575f-4537-a0ad-432df2106d89 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Action: 'create', calling method: .version_select at 0x7f4ff9a2a430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-204563884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgYX7PluhmbJgzkQqPBProD0gcEtBDHS9kLZC/YEozPBdCLAaE6RfBJQqlOAALR/29cZCU8nxhG4/wunT1+wux0gy8Sf7UIyOxd/FbayptzZRr4xqH4H4XA1v6qEjcKxQ=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:23.000330 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-299ccfd2-575f-4537-a0ad-432df2106d89 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Getting quotas for project 0bfa97b89b0b4bdba0b64d6c2d1a58f9. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:34:23.005021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-299ccfd2-575f-4537-a0ad-432df2106d89 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Getting quotas for user 6e2db3de0da54265adb783c13c377704 and project 0bfa97b89b0b4bdba0b64d6c2d1a58f9. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:34:23.027009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-299ccfd2-575f-4537-a0ad-432df2106d89 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046805 Sep 19 12:34:23.027591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1592/3130] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:34:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:34:23.044954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:23.045455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:23.052342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:23.052832 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:23.053298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:23.054029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:23.054487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:23.054912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:23.079708 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-337476883", "imageRef": "cd00c4dc-15b1-4401-b623-d5c7cc4a4fba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-204563884", "networks": [{"uuid": "418f5202-4367-42fd-88f0-8f2bc25871e5"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:23.081139 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:34:23.134991 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] validate_networks() for [('418f5202-4367-42fd-88f0-8f2bc25871e5', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:34:23.166230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d557a5f4-d013-49a5-a8d5-0ed80f5e64f0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 204 len: 0 microversion: 2.1 time: 0.124734 Sep 19 12:34:23.166973 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1539/3131] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:34:23 2022] DELETE /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:34:23.175516 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:23.176225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:23.182145 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:23.182630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:23.183069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:23.183816 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:23.184303 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:23.184735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:23.380153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:23.387905 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1068d333-5d36-41e6-9397-9d544f4bf1f8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1683 microversion: 2.1 time: 0.216670 Sep 19 12:34:23.388487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1540/3132] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:23 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:23.605589 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:34:23.606048 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:34:23.606521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:34:23.606932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:34:23.607343 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:34:23.616967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:23.617451 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:23.617926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:23.618655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:23.619132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:23.619561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:23.637312 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Getting quotas for project 0bfa97b89b0b4bdba0b64d6c2d1a58f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:34:23.641485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Getting quotas for user 6e2db3de0da54265adb783c13c377704 and project 0bfa97b89b0b4bdba0b64d6c2d1a58f9. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:34:23.652638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:34:23.654909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cd00c4dc-15b1-4401-b623-d5c7cc4a4fba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:34:23.703151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67426861-417a-4b30-82ba-40905f24fb7e tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627758 Sep 19 12:34:23.704053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1593/3133] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:34:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 12:34:23.715332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a8274a4f-4d98-4cc4-921e-ac4010d698da tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:23.715970 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a8274a4f-4d98-4cc4-921e-ac4010d698da tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:23.773418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a8274a4f-4d98-4cc4-921e-ac4010d698da tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:23.780698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a8274a4f-4d98-4cc4-921e-ac4010d698da tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1257 microversion: 2.1 time: 0.069743 Sep 19 12:34:23.781655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1541/3134] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:23 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:24.411851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:24.412455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:24.418645 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:24.419112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:24.419536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:24.420210 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:24.420653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:24.421069 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:24.552421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:24.561421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-370f953c-910d-473b-8a74-68d18bd84e8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1683 microversion: 2.1 time: 0.153965 Sep 19 12:34:24.562053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1594/3135] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:24 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:24.804780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:24.805509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:24.812042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:24.812608 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:24.813696 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:24.814485 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:24.815025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:24.815513 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:24.885908 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:24.894126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-67315a13-7d33-48a8-b7e2-ac449d5e06ad tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1309 microversion: 2.1 time: 0.093253 Sep 19 12:34:24.894705 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1542/3136] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:24 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:25.591654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:25.592217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:25.611620 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:25.612351 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:25.612962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:25.613842 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:25.614440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:25.615009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:25.759383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:25.768072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36fc5b65-b77b-4015-95bf-e5d429c73c24 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.181839 Sep 19 12:34:25.768709 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1595/3137] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:25 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:25.918902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:25.920583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:25.934264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:25.934757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:25.942882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:25.944991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:25.945637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:25.946284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:26.047370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:26.057754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4a4a9562-f989-4954-9f25-11b6a0fa6d4b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1315 microversion: 2.1 time: 0.144751 Sep 19 12:34:26.077044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1543/3138] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:25 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:26.092167 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-5647df8e-3aaf-4655-a7c8-363ea28c06f0 req-baa1cf67-79ba-43f8-8aeb-8502b9f4c9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4013ca3a-af58-4992-a620-6089699f6c35", "name": "network-vif-deleted", "tag": "c6905042-d423-484b-aa2f-bff15b552f57"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:26.111238 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5647df8e-3aaf-4655-a7c8-363ea28c06f0 req-baa1cf67-79ba-43f8-8aeb-8502b9f4c9e1 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:26.112234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5647df8e-3aaf-4655-a7c8-363ea28c06f0 req-baa1cf67-79ba-43f8-8aeb-8502b9f4c9e1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:26.113075 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5647df8e-3aaf-4655-a7c8-363ea28c06f0 req-baa1cf67-79ba-43f8-8aeb-8502b9f4c9e1 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:26.137963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-5647df8e-3aaf-4655-a7c8-363ea28c06f0 req-baa1cf67-79ba-43f8-8aeb-8502b9f4c9e1 service nova] Creating event network-vif-deleted:c6905042-d423-484b-aa2f-bff15b552f57 for instance 4013ca3a-af58-4992-a620-6089699f6c35 on hv-cinder-85829 Sep 19 12:34:26.163373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-5647df8e-3aaf-4655-a7c8-363ea28c06f0 req-baa1cf67-79ba-43f8-8aeb-8502b9f4c9e1 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078452 Sep 19 12:34:26.164366 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1596/3139] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:26.793559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:26.802742 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:26.809812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:26.814477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:26.815306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:26.816289 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:26.817004 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:26.817664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:26.926352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:26.937037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-130d3596-021e-45a4-a4fc-b9f323a8612a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.148304 Sep 19 12:34:26.938945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1544/3140] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:26 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:27.085712 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:27.087299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:27.095496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:27.096176 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:27.096863 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:27.097917 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:27.098540 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:27.099140 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:27.289617 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:27.301494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4da0ef16-089d-4566-b7b1-79ed8eaf618b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.221245 Sep 19 12:34:27.302785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1597/3141] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:27 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:27.963587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:27.964342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:27.971152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:27.971644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:27.972078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:27.972775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:27.973226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:27.973648 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:28.060855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:28.072767 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-4357bce4-5eed-40b6-93ac-28ef0b7d3c22 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.113342 Sep 19 12:34:28.089253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1545/3142] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:27 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:28.326195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:28.326783 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:28.335186 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:28.337347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:28.337347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:28.337701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:28.337936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:28.338567 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:28.480830 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:28.489684 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3df100a8-e53f-4017-8d16-8d135387650f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.167477 Sep 19 12:34:28.496031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1598/3143] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:28 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:29.097851 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:29.098484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:29.106675 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:29.107815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:29.108486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:29.109152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:29.109610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:29.110664 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:29.183739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:29.193196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-02ec4abd-664e-4c53-b93c-dba3352b0dcb tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.100091 Sep 19 12:34:29.193925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1546/3144] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:29 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:29.512988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:29.513695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:29.520610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:29.521101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:29.521527 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:29.522251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:29.522697 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:29.523112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:29.672325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:29.681121 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a051327a-7449-4be5-aad8-5881ffabd865 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.172201 Sep 19 12:34:29.681797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1599/3145] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:29 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:30.218501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:30.219325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:30.225885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:30.226324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:30.226758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:30.227456 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:30.227903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:30.228331 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:30.292390 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:30.301218 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6a59bc64-1160-44e1-90f2-222560fe5f34 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.087795 Sep 19 12:34:30.301926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1547/3146] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:30 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:30.704513 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:30.705521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:30.712638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:30.713401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:30.714061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:30.715016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:30.715546 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:30.716036 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:30.871404 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:30.883426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41f68671-3f9e-4787-ae84-cad667a2b9b7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.182660 Sep 19 12:34:30.884276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1600/3147] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:30 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:31.326172 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:31.326786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:31.333623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:31.334373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:31.334695 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:31.335417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:31.338493 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:31.338983 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:31.418413 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:31.423239 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:31.438416 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-aa3cf219-ce2a-472a-9253-06688518eab4 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.116194 Sep 19 12:34:31.439581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1548/3148] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:31 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:31.907551 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:31.908249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:31.914772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:31.915263 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:31.915696 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:31.916395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:31.916976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:31.917467 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:32.062715 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:32.071723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e14ddb5-2bb1-4f0e-92fa-39b78725763d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.168135 Sep 19 12:34:32.072295 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1601/3149] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:31 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:32.468916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:32.469636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:32.477219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:32.477704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:32.478160 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:32.478853 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:32.479437 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:32.479858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:32.546837 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:32.555380 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c441afc8-34d5-4eba-8c42-872200a27fe3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.091769 Sep 19 12:34:32.555942 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1549/3150] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:32 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:33.096220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:33.096814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:33.103379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:33.103861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:33.104296 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:33.104980 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:33.105427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:33.105878 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:33.232621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:33.240732 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d268179-e38b-4025-a2ee-6bff60bb7616 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.148387 Sep 19 12:34:33.241292 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1602/3151] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:33 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:33.578498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:33.579157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:33.585693 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:33.586467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:33.586904 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:33.587626 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:33.588083 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:33.588511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:33.651777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:33.660125 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0c34adc6-e114-4ea3-8661-e94fcbde22c0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1615 microversion: 2.1 time: 0.085591 Sep 19 12:34:33.660700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1550/3152] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:33 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:34.264370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:34.265016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:34.267227 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:34.268278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=10 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:34.274961 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:34.275446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:34.275881 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:34.276601 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:34.277032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:34.277455 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:34.411583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:34.419368 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db953447-80f2-41c2-9d96-8cb48b74dabf tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.159045 Sep 19 12:34:34.419924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1603/3153] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:34 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:34.688174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:34.688786 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:34.690961 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:34.697893 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:34.698377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:34.698900 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:34.699566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:34.700011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:34.700500 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:34.770363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:34.780092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f7565978-9de5-4ad4-b378-15561927966d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 200 len: 1327 microversion: 2.1 time: 0.096504 Sep 19 12:34:34.794188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1551/3154] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:34 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:35.372717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-97e3a546-039c-4a85-af17-eef7e48e5f61 req-7e8a3f9b-3bf2-49b8-a02b-bd33e4b17579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9873a7-c419-445a-8399-72af1d68cdf9", "tag": "281525b4-1c2a-467c-a60b-d7baea87f0d0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:35.389267 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-97e3a546-039c-4a85-af17-eef7e48e5f61 req-7e8a3f9b-3bf2-49b8-a02b-bd33e4b17579 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.390239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-97e3a546-039c-4a85-af17-eef7e48e5f61 req-7e8a3f9b-3bf2-49b8-a02b-bd33e4b17579 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.390876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-97e3a546-039c-4a85-af17-eef7e48e5f61 req-7e8a3f9b-3bf2-49b8-a02b-bd33e4b17579 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:35.406443 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-97e3a546-039c-4a85-af17-eef7e48e5f61 req-7e8a3f9b-3bf2-49b8-a02b-bd33e4b17579 service nova] Creating event network-changed:281525b4-1c2a-467c-a60b-d7baea87f0d0 for instance 7e9873a7-c419-445a-8399-72af1d68cdf9 on hv-cinder-85829 Sep 19 12:34:35.413946 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-97e3a546-039c-4a85-af17-eef7e48e5f61 req-7e8a3f9b-3bf2-49b8-a02b-bd33e4b17579 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048940 Sep 19 12:34:35.414549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1604/3155] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:34:35.444282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:35.444926 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:35.451023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.451521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.451965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:35.452673 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.453130 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.453806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:35.587506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:35.596195 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d6ae698d-9b7d-4db5-93a5-4bdb16a76779 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.155803 Sep 19 12:34:35.597134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1552/3156] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:35 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:35.804413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:35.805050 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:35.811181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.811681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.812114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:35.812838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:35.813289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:35.813706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:35.827403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 HTTP/1.1 Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:34:35.830150 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:34:35.831794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '4013ca3a-af58-4992-a620-6089699f6c35'} Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:34:35.832605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:34:35.833903 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:34:35.835228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:34:35.835228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0830ea5-11c2-4194-b2a1-f40def0bd860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 404 len: 111 microversion: 2.1 time: 0.031644 Sep 19 12:34:35.835228 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1605/3157] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:35 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:34:35.840988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5442be96-3bf2-4c0d-8328-61b0c2ef207d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '.version_select at 0x7f4ff6077430>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:35.846552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5442be96-3bf2-4c0d-8328-61b0c2ef207d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [24db2afc-b0e2-4f1e-bb54-a75212366b90] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:34:36.623464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:36.624117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:36.631394 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:36.631876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:36.632306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:36.633007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:36.633447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:36.634017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:36.655383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:36.780123 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:36.788798 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58ade622-2811-4d03-8eee-01a66242af31 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.169185 Sep 19 12:34:36.789384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1606/3158] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:36 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:36.854372 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [None req-5442be96-3bf2-4c0d-8328-61b0c2ef207d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [24db2afc-b0e2-4f1e-bb54-a75212366b90] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 56220. Sep 19 12:34:36.873607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5442be96-3bf2-4c0d-8328-61b0c2ef207d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068294436" status: 202 len: 0 microversion: 2.1 time: 1.036461 Sep 19 12:34:36.874226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1553/3159] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Sep 19 12:34:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1068294436 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:34:37.645239 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6164145-5c41-4395-a381-4631c7c71153 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: .version_select at 0x7f4ff60721f0>, body: {"keypair": {"name": "tempest-keypair-1589618095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6rMaUzbB5bqxkYXm5M+5tORuIITGCL5gbt4NRE4J+DPk29bRW/eHjrU68MUyyt8GWb4iMuMk9CfAn/D+bmjiAgxKv2edouMyAiwr97Bocq1nV/kR4t3MiO5Q5wvuGKDw=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:37.661515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-e6164145-5c41-4395-a381-4631c7c71153 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:34:37.665306 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-e6164145-5c41-4395-a381-4631c7c71153 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:34:37.689118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6164145-5c41-4395-a381-4631c7c71153 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048231 Sep 19 12:34:37.689711 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1607/3160] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:34:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:37.816697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:37.817313 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:37.825036 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:37.825644 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:37.826124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:37.826840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:37.827297 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:37.827833 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:37.975768 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:37.993749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d08f46df-3100-4654-9379-73a5cde2fb80 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.172201 Sep 19 12:34:37.993749 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1554/3161] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:37 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:39.011792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:39.012331 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:39.019395 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:39.019884 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:39.020319 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:39.021011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:39.021466 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:39.021923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:39.216353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:39.225027 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39d7b928-9fab-4d52-a05c-6809b6c21c68 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.217736 Sep 19 12:34:39.225599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1608/3162] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:39 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:39.278490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-8795739", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec1d8dc8-9672-46f8-8c41-7f866e0c00cf"}], "security_groups": [{"name": "tempest-securitygroup--967898293"}], "key_name": "tempest-keypair-1589618095", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:39.385288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] validate_networks() for [('ec1d8dc8-9672-46f8-8c41-7f866e0c00cf', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:34:39.760552 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:34:39.760975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:34:39.761458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:34:39.761910 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:34:39.762330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:34:39.771210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:39.771698 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:39.772133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:39.772859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:39.773311 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:39.773734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:39.791634 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:34:39.796957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:34:39.809745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:34:39.812006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:34:39.859162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6eac6e77-d4be-48ac-896b-abd1b1c0506b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.584999 Sep 19 12:34:39.860323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1555/3163] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:34:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:34:39.871839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-211d6d5d-8f53-42d7-b4ce-8a1a4485d844 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:39.872543 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-211d6d5d-8f53-42d7-b4ce-8a1a4485d844 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:39.935772 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-211d6d5d-8f53-42d7-b4ce-8a1a4485d844 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:39.951402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-211d6d5d-8f53-42d7-b4ce-8a1a4485d844 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1239 microversion: 2.1 time: 0.082852 Sep 19 12:34:39.953851 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1609/3164] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:39 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:40.247878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:40.248534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:40.254965 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:40.255457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:40.255898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:40.256597 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:40.257052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:40.257479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:40.405913 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:40.415703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1af9bf84-7590-460d-87b4-c8edb8fe7457 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.171782 Sep 19 12:34:40.416275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1556/3165] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:40 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:40.977481 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:40.978040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:40.984204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:40.984694 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:40.985127 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:40.986012 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:40.986472 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:40.986895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:41.056195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:41.065099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8a5724e-bdb1-44eb-802a-9610cda277c2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1309 microversion: 2.1 time: 0.091882 Sep 19 12:34:41.065833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1610/3166] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:40 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:41.440367 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:41.440980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:41.448400 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:41.448883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:41.449445 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:41.450173 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:41.450620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:41.451037 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:41.603226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:41.613641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5e2ccc73-27eb-4f75-bb68-117483945456 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.177757 Sep 19 12:34:41.614301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1557/3167] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:41 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:42.085070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-905ac53b-ca50-4e75-9e2f-22d644698463 req-281c726e-202a-4478-86cc-3fb3b71eeabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9873a7-c419-445a-8399-72af1d68cdf9", "name": "network-vif-plugged", "status": "completed", "tag": "281525b4-1c2a-467c-a60b-d7baea87f0d0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:42.091584 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:42.092528 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:42.101010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.101701 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-905ac53b-ca50-4e75-9e2f-22d644698463 req-281c726e-202a-4478-86cc-3fb3b71eeabf service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.101867 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.102501 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:42.102840 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-905ac53b-ca50-4e75-9e2f-22d644698463 req-281c726e-202a-4478-86cc-3fb3b71eeabf service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.103359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.104079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.104595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:42.104896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-905ac53b-ca50-4e75-9e2f-22d644698463 req-281c726e-202a-4478-86cc-3fb3b71eeabf service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:42.119281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-905ac53b-ca50-4e75-9e2f-22d644698463 req-281c726e-202a-4478-86cc-3fb3b71eeabf service nova] Creating event network-vif-plugged:281525b4-1c2a-467c-a60b-d7baea87f0d0 for instance 7e9873a7-c419-445a-8399-72af1d68cdf9 on hv-cinder-85829 Sep 19 12:34:42.127958 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-905ac53b-ca50-4e75-9e2f-22d644698463 req-281c726e-202a-4478-86cc-3fb3b71eeabf service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047168 Sep 19 12:34:42.129653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1611/3168] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:42.279061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:42.287616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-31c18930-1788-4a75-b799-bb7fa0767c2c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1364 microversion: 2.1 time: 0.202623 Sep 19 12:34:42.288196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1558/3169] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:42 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:42.391929 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-455af1a2-95f7-40e5-b73e-1715fcdebc7c req-cf5bf87f-cdc1-4a20-aa12-938ef7d04de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ed39b8-ddb1-4468-928d-41cf1c0a301a", "tag": "370dc1a8-d657-4d84-9f58-efdacaf5f8c2"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:42.400524 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:42.405877 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-455af1a2-95f7-40e5-b73e-1715fcdebc7c req-cf5bf87f-cdc1-4a20-aa12-938ef7d04de2 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.406334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-455af1a2-95f7-40e5-b73e-1715fcdebc7c req-cf5bf87f-cdc1-4a20-aa12-938ef7d04de2 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.406774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-455af1a2-95f7-40e5-b73e-1715fcdebc7c req-cf5bf87f-cdc1-4a20-aa12-938ef7d04de2 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:42.419667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-455af1a2-95f7-40e5-b73e-1715fcdebc7c req-cf5bf87f-cdc1-4a20-aa12-938ef7d04de2 service nova] Creating event network-changed:370dc1a8-d657-4d84-9f58-efdacaf5f8c2 for instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a on hv-cinder-85829 Sep 19 12:34:42.424651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-455af1a2-95f7-40e5-b73e-1715fcdebc7c req-cf5bf87f-cdc1-4a20-aa12-938ef7d04de2 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037786 Sep 19 12:34:42.425437 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1612/3170] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:42.636619 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:42.637152 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:42.644188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.644665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.645093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:42.645823 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:42.646291 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:42.646708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:42.777373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:42.785334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6408373d-aa28-4959-906a-28d3bc276f82 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.152658 Sep 19 12:34:42.785932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1559/3171] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:42 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:43.313314 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:43.314030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:43.320182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:43.320653 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:43.321081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:43.321750 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:43.322550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:43.323278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:43.455896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:43.463780 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d21875c8-2df3-45b1-84c3-2d3f0d0f829e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1364 microversion: 2.1 time: 0.155910 Sep 19 12:34:43.464339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1613/3172] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:43 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:43.808881 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:43.809512 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:43.816001 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:43.816480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:43.816911 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:43.817593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:43.818074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:43.818491 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:43.948217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:43.956616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c3d7e0b7-e4e2-4889-a726-f0fb0138daae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1357 microversion: 2.1 time: 0.151605 Sep 19 12:34:43.957174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1560/3173] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:43 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:44.488003 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:44.488618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:44.496654 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:44.497143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:44.497586 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:44.498324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:44.498777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:44.499199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:44.636964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:44.646341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-927a4e28-83bc-4ed0-b3c5-b3e6e73c80f1 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1364 microversion: 2.1 time: 0.162683 Sep 19 12:34:44.647138 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1614/3174] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:44 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:44.979963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:44.980569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:44.987744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:44.988226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:44.988670 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:44.989362 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:44.989848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:44.990276 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.120461 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:45.128183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c7a3bc3b-c3a9-48ce-aa67-636b03d80493 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1546 microversion: 2.1 time: 0.152134 Sep 19 12:34:45.128756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1561/3175] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:44 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:45.151133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:45.151766 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:45.158492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.158975 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.159407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.160091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.160539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.160960 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.294608 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:45.302229 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e54c538a-5c0d-43ea-b888-0a2b5f9fd35c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1546 microversion: 2.1 time: 0.155045 Sep 19 12:34:45.302796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1615/3176] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:45 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:45.324135 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:45.329690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:45.330492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Searching by: {'deleted': False, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9'} {{(pid=120644) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 12:34:45.337477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.338100 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.338878 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.339863 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.340264 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.340692 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.436324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.multi_cell_list [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120644) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 12:34:45.533219 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-a15126f3-7e15-4d4e-9472-5e901701b04c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212923 Sep 19 12:34:45.533824 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1562/3177] 10.222.0.88 () {58 vars in 1125 bytes} [Mon Sep 19 12:34:45 2022] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:45.545550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:45.546192 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:45.552266 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.552746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.553181 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.553896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.554347 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.554765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.671877 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:45.672505 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:45.678590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.679079 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.679509 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.680207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:45.680652 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:45.681069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:45.688976 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:45.698749 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f160f9b-6581-4a94-916e-6b4b17cca770 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1546 microversion: 2.1 time: 0.156756 Sep 19 12:34:45.699337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1616/3178] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:45 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:45.826281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:45.835074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-29555000-69b6-49db-b80d-7747e2a7443d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1364 microversion: 2.1 time: 0.167122 Sep 19 12:34:45.835757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1563/3179] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:45 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:34:46.860164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:46.860774 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:46.867284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:46.867769 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:46.868205 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:46.868896 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:46.869349 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:46.869781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:47.007383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:47.015218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-680f5eec-73e9-4a6e-906d-bf82086ad630 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1364 microversion: 2.1 time: 0.158892 Sep 19 12:34:47.016410 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1617/3180] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:46 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:47.316730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fa6289d-5509-4118-a311-8e70e00b2178"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:47.319269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:47.321564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:47.326939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:47.327429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:47.327871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:47.328565 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:47.329023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:47.329448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:47.584812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-debc5fff-8c43-4f6f-ab9a-686f8d1f9107 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272384 Sep 19 12:34:47.585624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1564/3181] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:34:47 2022] POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:34:48.038392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:48.039006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:48.045597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:48.046147 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:48.046583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:48.047288 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:48.047738 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:48.048163 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:48.131995 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-55e3d76e-d6d3-4baa-9737-86bd35bf87be req-db2a0333-d9f7-4fb1-a5f8-cf0f2d5d8e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ed39b8-ddb1-4468-928d-41cf1c0a301a", "name": "network-vif-plugged", "status": "completed", "tag": "370dc1a8-d657-4d84-9f58-efdacaf5f8c2"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:48.150371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-55e3d76e-d6d3-4baa-9737-86bd35bf87be req-db2a0333-d9f7-4fb1-a5f8-cf0f2d5d8e5e service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:48.150862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-55e3d76e-d6d3-4baa-9737-86bd35bf87be req-db2a0333-d9f7-4fb1-a5f8-cf0f2d5d8e5e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:48.151332 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-55e3d76e-d6d3-4baa-9737-86bd35bf87be req-db2a0333-d9f7-4fb1-a5f8-cf0f2d5d8e5e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:48.164991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-55e3d76e-d6d3-4baa-9737-86bd35bf87be req-db2a0333-d9f7-4fb1-a5f8-cf0f2d5d8e5e service nova] Creating event network-vif-plugged:370dc1a8-d657-4d84-9f58-efdacaf5f8c2 for instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a on hv-cinder-85829 Sep 19 12:34:48.171277 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-55e3d76e-d6d3-4baa-9737-86bd35bf87be req-db2a0333-d9f7-4fb1-a5f8-cf0f2d5d8e5e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051873 Sep 19 12:34:48.172815 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1565/3182] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:34:48.188827 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:48.197549 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99b92448-7905-4a6a-a84c-9c1ddc5007ca tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1364 microversion: 2.1 time: 0.162911 Sep 19 12:34:48.198191 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1618/3183] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:48 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:49.223998 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:49.224799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:49.232014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:49.232514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:49.232951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:49.233783 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:49.234990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:49.235418 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:49.240235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:49.393203 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:49.400991 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c511ea0f-f317-4a76-ac90-46a823820e18 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1364 microversion: 2.1 time: 0.182931 Sep 19 12:34:49.401484 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1566/3184] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:49 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:50.427057 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:50.428997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:50.431136 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:50.436412 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:50.436899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:50.437336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:50.438067 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:50.438521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:50.438943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:50.587782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:50.596794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6bd5340-edff-4586-a1cb-331837f874cf tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1555 microversion: 2.1 time: 0.175317 Sep 19 12:34:50.597399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1619/3185] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:50 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:50.623761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:50.624324 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:50.627052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:50.632948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:50.633427 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:50.633898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:50.634587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:50.635040 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:50.635464 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:50.713042 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9ba29f25-40fa-4089-90e3-ca077c074477 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093226 Sep 19 12:34:50.713641 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1567/3186] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Sep 19 12:34:50 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:51.709359 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-698f6f40-5e3a-496b-b6fe-4d9ae71a31e1 req-b7dda8af-57a3-46c7-b232-f7a2521809d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ed39b8-ddb1-4468-928d-41cf1c0a301a", "tag": "370dc1a8-d657-4d84-9f58-efdacaf5f8c2"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:51.721077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-698f6f40-5e3a-496b-b6fe-4d9ae71a31e1 req-b7dda8af-57a3-46c7-b232-f7a2521809d5 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:51.721933 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-698f6f40-5e3a-496b-b6fe-4d9ae71a31e1 req-b7dda8af-57a3-46c7-b232-f7a2521809d5 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:51.722510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-698f6f40-5e3a-496b-b6fe-4d9ae71a31e1 req-b7dda8af-57a3-46c7-b232-f7a2521809d5 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:51.739388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-698f6f40-5e3a-496b-b6fe-4d9ae71a31e1 req-b7dda8af-57a3-46c7-b232-f7a2521809d5 service nova] Creating event network-changed:370dc1a8-d657-4d84-9f58-efdacaf5f8c2 for instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a on hv-cinder-85829 Sep 19 12:34:51.744882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-698f6f40-5e3a-496b-b6fe-4d9ae71a31e1 req-b7dda8af-57a3-46c7-b232-f7a2521809d5 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039428 Sep 19 12:34:51.745474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1620/3187] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:54.188599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:54.189178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:54.195789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:54.196272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:54.196710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:54.197404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:54.198323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:54.198323 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:54.332654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:54.341268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8be5f7fc-1cbe-40eb-9009-92d70f5278a4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1592 microversion: 2.1 time: 0.158316 Sep 19 12:34:54.341868 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1568/3188] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:54 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1592 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:56.216171 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c69532df-3cde-4c7f-aa3e-0a0239d46e91 req-f7a8a08d-228c-436e-81d7-1df9516795f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9873a7-c419-445a-8399-72af1d68cdf9", "tag": "281525b4-1c2a-467c-a60b-d7baea87f0d0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:56.227348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c69532df-3cde-4c7f-aa3e-0a0239d46e91 req-f7a8a08d-228c-436e-81d7-1df9516795f7 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:56.228151 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c69532df-3cde-4c7f-aa3e-0a0239d46e91 req-f7a8a08d-228c-436e-81d7-1df9516795f7 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:56.228585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c69532df-3cde-4c7f-aa3e-0a0239d46e91 req-f7a8a08d-228c-436e-81d7-1df9516795f7 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:56.241658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c69532df-3cde-4c7f-aa3e-0a0239d46e91 req-f7a8a08d-228c-436e-81d7-1df9516795f7 service nova] Creating event network-changed:281525b4-1c2a-467c-a60b-d7baea87f0d0 for instance 7e9873a7-c419-445a-8399-72af1d68cdf9 on hv-cinder-85829 Sep 19 12:34:56.246737 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c69532df-3cde-4c7f-aa3e-0a0239d46e91 req-f7a8a08d-228c-436e-81d7-1df9516795f7 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034457 Sep 19 12:34:56.247632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1621/3189] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:34:57.508777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1474458405"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:57.509352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:57.511643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=4 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:34:57.521226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:57.521724 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:57.522196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:57.523975 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:57.524432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:57.524858 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:57.659488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.network.security_group_api [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Adding security group 5da09471-d314-43f1-a6f1-d7ac705da700 to port 281525b4-1c2a-467c-a60b-d7baea87f0d0 Sep 19 12:34:58.040477 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2423410b-723d-46e2-9a37-62980371718b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.535520 Sep 19 12:34:58.041118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1569/3190] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 12:34:57 2022] POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:34:58.050576 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:34:58.051388 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:34:58.058652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:58.059143 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:58.059723 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:58.060595 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:58.061046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:58.061456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:58.236220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:34:58.244853 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa423d00-7c68-4735-b1b5-908ef278084c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1756 microversion: 2.1 time: 0.199059 Sep 19 12:34:58.245439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1622/3191] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:34:58 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:34:58.261681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-f125068e-81ea-4b2b-ba00-1b9916c81c8f req-6bc6442a-2251-445a-9507-fdf3806fa8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9873a7-c419-445a-8399-72af1d68cdf9", "tag": "281525b4-1c2a-467c-a60b-d7baea87f0d0"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:34:58.273137 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f125068e-81ea-4b2b-ba00-1b9916c81c8f req-6bc6442a-2251-445a-9507-fdf3806fa8eb service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:34:58.273708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f125068e-81ea-4b2b-ba00-1b9916c81c8f req-6bc6442a-2251-445a-9507-fdf3806fa8eb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:34:58.274242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-f125068e-81ea-4b2b-ba00-1b9916c81c8f req-6bc6442a-2251-445a-9507-fdf3806fa8eb service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:34:58.285963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-f125068e-81ea-4b2b-ba00-1b9916c81c8f req-6bc6442a-2251-445a-9507-fdf3806fa8eb service nova] Creating event network-changed:281525b4-1c2a-467c-a60b-d7baea87f0d0 for instance 7e9873a7-c419-445a-8399-72af1d68cdf9 on hv-cinder-85829 Sep 19 12:34:58.291223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-f125068e-81ea-4b2b-ba00-1b9916c81c8f req-6bc6442a-2251-445a-9507-fdf3806fa8eb service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033833 Sep 19 12:34:58.292242 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1570/3192] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:20.876651 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:20.878922 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:20.881045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=20 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:20.881707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=70 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:20.888322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:20.888806 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:20.889244 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:20.890010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:20.890511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:20.890942 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:20.964011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-920f1b12-3815-4dbc-8bae-1863a78c0347 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.091492 Sep 19 12:35:20.964634 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1623/3193] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 12:35:20 2022] POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:35:20.974378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=13 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:20.974378 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=20 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:20.976524 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:20.977238 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:20.984683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:20.985214 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:20.986812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:20.986812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:20.986812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:20.987267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:21.147171 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:21.156072 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-53d9d534-3fe5-4daa-beb5-a3f30f96706f tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1748 microversion: 2.1 time: 0.186943 Sep 19 12:35:21.156885 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1571/3194] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:20 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1748 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:22.180602 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:22.181353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:22.187725 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:22.188209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:22.188649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:22.189440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:22.189931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:22.190353 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:22.332144 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:22.340621 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c5bd338-9106-4c9a-9c53-f5a491e1093a tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.164807 Sep 19 12:35:22.341175 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1624/3195] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:22 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:23.365354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:23.366031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:23.372458 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:23.372936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:23.373373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:23.374106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:23.374559 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:23.374980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:23.518041 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:23.526714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b33be0cb-9d5c-44fa-b8f5-1b3140b4d437 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.165218 Sep 19 12:35:23.527282 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1572/3196] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:23 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:24.550058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:24.550640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:24.557042 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:24.557514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:24.557981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:24.558658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:24.559101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:24.559518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:24.706615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:24.715113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c47f3808-88cd-42c6-9df9-dba4e65230b8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.168983 Sep 19 12:35:24.715678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1625/3197] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:24 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:25.739514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:25.740775 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:25.747564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:25.748103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:25.748549 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:25.749256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:25.749711 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:25.750167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:25.908562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:25.916879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-377c3f84-7e45-4710-90b0-635ced80a151 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.181245 Sep 19 12:35:25.917739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1573/3198] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:25 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:26.939456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:26.940089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:26.947077 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:26.947568 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:26.947988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:26.948682 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:26.949133 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:26.949561 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:27.099446 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:27.107828 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63119d92-3763-4741-817d-13144465f0b9 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.172426 Sep 19 12:35:27.108399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1626/3199] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:26 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:27.670763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:27.671317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:27.679049 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:27.679523 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:27.679976 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:27.680659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:27.681105 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:27.681614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:27.711379 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-94bcd653-56f6-412c-8dcb-b0ba75504d9d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/ips" status: 200 len: 150 microversion: 2.1 time: 0.044125 Sep 19 12:35:27.711969 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1574/3200] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 12:35:27 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:28.131923 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:28.132474 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:28.138906 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:28.139387 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:28.139820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:28.140511 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:28.141002 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:28.141426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:28.297507 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:28.305825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c93251b-46ed-4b8e-9178-ae9b0f0bfcea tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.178021 Sep 19 12:35:28.306420 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1627/3201] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:28 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:29.056003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d58a18-0f20-43cf-90fe-3747e1eb9b07"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:29.058404 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:29.067224 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:29.067706 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:29.068142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:29.068829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:29.069275 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:29.069721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:29.322800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-9bd29056-4e39-47a3-badc-e58db79a5a2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270547 Sep 19 12:35:29.323703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1575/3202] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:35:29 2022] POST /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:29.328278 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:29.328876 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:29.339063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:29.339999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:29.340728 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:29.341910 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:29.342765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:29.343379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:29.528373 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:29.537117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db530433-1d81-4e8f-936f-09bc27ce2794 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.212713 Sep 19 12:35:29.537685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1628/3203] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:29 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:35:30.561647 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:30.562373 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:30.569325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:30.569822 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:30.570258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:30.570938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:30.571388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:30.571800 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:30.718136 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:30.726883 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c9edafd6-6371-457e-94f3-01fc882b8bde tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.170072 Sep 19 12:35:30.727463 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1576/3204] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:30 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:31.751039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:31.751642 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:31.758974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:31.759459 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:31.759887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:31.760569 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:31.761014 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:31.761448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:31.913938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:31.920521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5cc28610-e135-4a92-b689-487ecc0923ae tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1753 microversion: 2.1 time: 0.173533 Sep 19 12:35:31.921091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1629/3205] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:31 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:32.945064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:32.945633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:32.952110 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:32.952593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:32.953065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:32.953757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:32.954234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:32.954657 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:33.104235 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:33.112388 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-146d5cfe-6fa7-4173-ae6f-39c028217be4 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1756 microversion: 2.1 time: 0.171848 Sep 19 12:35:33.112943 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1577/3206] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:32 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:35.836114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0d58a18-0f20-43cf-90fe-3747e1eb9b07"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:35.838492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:35.845056 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:35.845538 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:35.846005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:35.846695 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:35.847149 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:35.847573 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:35.926456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Invalid volume: volume a0d58a18-0f20-43cf-90fe-3747e1eb9b07 is already attached to instances: 53ed39b8-ddb1-4468-928d-41cf1c0a301a Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: POST /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments HTTP/1.1 Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 74 Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:35:35.928209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {"volumeAttachment": {"volumeId": "a0d58a18-0f20-43cf-90fe-3747e1eb9b07"}} Sep 19 12:35:35.929713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Invalid volume: volume a0d58a18-0f20-43cf-90fe-3747e1eb9b07 is already attached to instances: 53ed39b8-ddb1-4468-928d-41cf1c0a301a Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'server_id': '53ed39b8-ddb1-4468-928d-41cf1c0a301a', 'body': {'volumeAttachment': {'volumeId': 'a0d58a18-0f20-43cf-90fe-3747e1eb9b07'}}} Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a0d58a18-0f20-43cf-90fe-3747e1eb9b07 is already attached to instances: 53ed39b8-ddb1-4468-928d-41cf1c0a301a Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.931746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a0d58a18-0f20-43cf-90fe-3747e1eb9b07 is already attached to instances: 53ed39b8-ddb1-4468-928d-41cf1c0a301a Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:35.932938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a0d58a18-0f20-43cf-90fe-3747e1eb9b07 is already attached to instances: 53ed39b8-ddb1-4468-928d-41cf1c0a301a Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 400 to user: Invalid volume: volume a0d58a18-0f20-43cf-90fe-3747e1eb9b07 is already attached to instances: 53ed39b8-ddb1-4468-928d-41cf1c0a301a {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d590f48-573b-4f25-bde8-13009710a5a2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098382 Sep 19 12:35:35.934101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1630/3207] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:35:35 2022] POST /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:35:35.995307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:35.995814 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:36.002480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:36.003272 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:36.004013 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:36.005687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:36.006478 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:36.007196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:36.091740 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lazy-loading 'services' on Instance uuid 53ed39b8-ddb1-4468-928d-41cf1c0a301a {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:35:36.164980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-306b60fe-a26b-44bd-ae82-7eef34d00d69 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments/a0d58a18-0f20-43cf-90fe-3747e1eb9b07" status: 202 len: 0 microversion: 2.1 time: 0.173431 Sep 19 12:35:36.165841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1578/3208] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:35:35 2022] DELETE /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments/a0d58a18-0f20-43cf-90fe-3747e1eb9b07 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:35:36.175082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:36.177235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:36.184652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:36.185810 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:36.186272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:36.187211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:36.187667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:36.188087 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:36.222691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4885af21-e2d2-447f-a6f9-05d9c91f7d8b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052418 Sep 19 12:35:36.223285 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1631/3209] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:35:36 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:37.235241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:37.237610 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:37.244226 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:37.244717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:37.245141 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:37.245855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:37.246310 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:37.246732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:37.275357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-71f37c26-0e87-4de9-b435-42b2354cbdb7 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044424 Sep 19 12:35:37.275903 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1579/3210] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:35:37 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:35:37.338423 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:37.338931 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:37.345308 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:37.345814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:37.346248 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:37.346932 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:37.347380 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:37.347804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:37.372899 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:35:37.459560 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa86c9a7-b4ec-471b-9467-f4be382871e8 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 204 len: 0 microversion: 2.1 time: 0.124698 Sep 19 12:35:37.460224 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1632/3211] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:35:37 2022] DELETE /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:35:37.469168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:37.469755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:37.479968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:37.480451 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:37.480884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:37.481585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:37.482070 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:37.482494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:37.611170 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:37.618953 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-665dbd6a-0f54-4d42-b618-a0757923dd7b tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1679 microversion: 2.1 time: 0.153890 Sep 19 12:35:37.619518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1580/3212] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:37 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:38.643562 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:38.644257 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:38.650553 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:38.651031 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:38.651463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:38.652146 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:38.652592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:38.653015 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:38.791091 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:38.803908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-197ad381-b9c6-4c7a-a02a-cde7cf48fdd6 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1679 microversion: 2.1 time: 0.164236 Sep 19 12:35:38.804822 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1633/3213] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:38 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:39.839431 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:39.840803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:39.848582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:39.848928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:39.849757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:39.851095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:39.851739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:39.852392 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:39.857794 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-6d4176be-fd90-4487-86a6-eb4bec5c7250 req-e99b56f9-3365-47be-9b5f-ee314d2d812e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ed39b8-ddb1-4468-928d-41cf1c0a301a", "name": "network-vif-deleted", "tag": "370dc1a8-d657-4d84-9f58-efdacaf5f8c2"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:39.869253 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6d4176be-fd90-4487-86a6-eb4bec5c7250 req-e99b56f9-3365-47be-9b5f-ee314d2d812e service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:39.869721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6d4176be-fd90-4487-86a6-eb4bec5c7250 req-e99b56f9-3365-47be-9b5f-ee314d2d812e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:39.870194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-6d4176be-fd90-4487-86a6-eb4bec5c7250 req-e99b56f9-3365-47be-9b5f-ee314d2d812e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:39.884988 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-6d4176be-fd90-4487-86a6-eb4bec5c7250 req-e99b56f9-3365-47be-9b5f-ee314d2d812e service nova] Creating event network-vif-deleted:370dc1a8-d657-4d84-9f58-efdacaf5f8c2 for instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a on hv-cinder-85829 Sep 19 12:35:39.890811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-6d4176be-fd90-4487-86a6-eb4bec5c7250 req-e99b56f9-3365-47be-9b5f-ee314d2d812e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036184 Sep 19 12:35:39.891377 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1634/3214] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:39.925124 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:39.936829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6d0c0efb-4f7d-4eb8-9e9a-74c61a172bc5 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 200 len: 1612 microversion: 2.1 time: 0.101741 Sep 19 12:35:39.937677 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1581/3215] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:39 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 1612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:40.962516 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:40.963208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:40.969908 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:40.970364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:40.970796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:40.971495 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:40.971940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:40.972354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:40.987040 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a HTTP/1.1 Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:35:40.988759 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:35:40.990348 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '53ed39b8-ddb1-4468-928d-41cf1c0a301a'} Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:35:40.991099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:35:40.992208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:35:40.993218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:35:40.993218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f4e6fc7-a12d-41ee-bbf6-a19aa1076634 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 404 len: 111 microversion: 2.1 time: 0.033127 Sep 19 12:35:40.993218 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1635/3216] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:40 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:35:40.999754 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-af02d164-638e-47bd-ae72-410f574914a0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '.version_select at 0x7f4ff6464700>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:41.022429 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-af02d164-638e-47bd-ae72-410f574914a0 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589618095" status: 202 len: 0 microversion: 2.1 time: 0.026603 Sep 19 12:35:41.023027 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1582/3217] 10.222.0.88 () {58 vars in 1221 bytes} [Mon Sep 19 12:35:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589618095 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:35:41.653924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-33e90300-3feb-42f8-bd4e-3bc1665122db tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: .version_select at 0x7f4ff64a2310>, body: {"keypair": {"name": "tempest-keypair-395683776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtfjc/x7VY/IBGTfsNatw9GVrrqb79ogItGzHWiDGtP4q3KF5v54Wr4GFc0DGw7cRHCHxeOF8AVg/uHWKgoTCs91t9dMIisYKqwowxXKPxjs4ojY1OgrKDQeOVVnlmsvw=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:41.669272 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-33e90300-3feb-42f8-bd4e-3bc1665122db tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:35:41.673206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-33e90300-3feb-42f8-bd4e-3bc1665122db tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:35:41.696814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-33e90300-3feb-42f8-bd4e-3bc1665122db tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046870 Sep 19 12:35:41.697407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1636/3218] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:35:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:42.940659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-341526840", "imageRef": "1032c3e6-9534-405e-a78e-86b76fa1f9cf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec1d8dc8-9672-46f8-8c41-7f866e0c00cf"}], "security_groups": [{"name": "tempest-securitygroup--664866080"}], "key_name": "tempest-keypair-395683776", "user_data": "}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:43.049496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.network.neutron [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] validate_networks() for [('ec1d8dc8-9672-46f8-8c41-7f866e0c00cf', None, None, None, None, None)] {{(pid=120644) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:35:43.436793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:35:43.437213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image limits 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:35:43.437710 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Flavor pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:35:43.438123 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Image pref 0:0:0 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:35:43.438562 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.virt.hardware [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:35:43.447602 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:43.448081 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:43.448511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:43.449231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:43.449683 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:43.450133 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:43.467342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:35:43.471240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.quota [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Getting quotas for user f4fd2deca6124518ae1df9ed7977f350 and project 3da2a386a837446dad4bf8b8506e418d. Resources: {'cores', 'instances', 'ram'} {{(pid=120644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:35:43.482916 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Going to run 1 instances... {{(pid=120644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:35:43.485225 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1032c3e6-9534-405e-a78e-86b76fa1f9cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:35:43.537530 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-d5712222-cbba-4c45-8a25-a725baf467b9 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601956 Sep 19 12:35:43.538487 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1583/3219] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:35:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:35:43.550054 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a7dec3b-4b44-44b1-a6f4-dc1dec531e8f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:43.550803 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a7dec3b-4b44-44b1-a6f4-dc1dec531e8f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:43.607461 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a7dec3b-4b44-44b1-a6f4-dc1dec531e8f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:43.615202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a7dec3b-4b44-44b1-a6f4-dc1dec531e8f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1240 microversion: 2.1 time: 0.069769 Sep 19 12:35:43.615771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1637/3220] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:43 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:44.638479 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:44.639374 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:44.645700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:44.646278 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:44.646720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:44.647412 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:44.647859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:44.648274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:44.723600 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:44.731835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-998730fc-8bfb-4d63-9a43-db351c808860 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1310 microversion: 2.1 time: 0.097752 Sep 19 12:35:44.732585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1584/3221] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:44 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:45.757217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:45.757802 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:45.763683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:45.764169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:45.764605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:45.765298 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:45.765746 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:45.766386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:45.911492 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:45.922299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4260ed58-99a6-4204-a07a-95934dbf1f52 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.169397 Sep 19 12:35:45.922580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1638/3222] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:45 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:46.147537 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-c62c7878-71e7-4ab2-ba7a-00899ec7a57e req-001a31b7-f5a0-49db-9c30-acd1a2ba4479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85737fc-d3e0-4533-88a6-453fc428769b", "tag": "6a7f23f8-7d14-46b6-adc6-d66505ee6f5a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:46.159987 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c62c7878-71e7-4ab2-ba7a-00899ec7a57e req-001a31b7-f5a0-49db-9c30-acd1a2ba4479 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:46.160465 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c62c7878-71e7-4ab2-ba7a-00899ec7a57e req-001a31b7-f5a0-49db-9c30-acd1a2ba4479 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:46.160891 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-c62c7878-71e7-4ab2-ba7a-00899ec7a57e req-001a31b7-f5a0-49db-9c30-acd1a2ba4479 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:46.172727 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-c62c7878-71e7-4ab2-ba7a-00899ec7a57e req-001a31b7-f5a0-49db-9c30-acd1a2ba4479 service nova] Creating event network-changed:6a7f23f8-7d14-46b6-adc6-d66505ee6f5a for instance c85737fc-d3e0-4533-88a6-453fc428769b on hv-cinder-85829 Sep 19 12:35:46.178467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-c62c7878-71e7-4ab2-ba7a-00899ec7a57e req-001a31b7-f5a0-49db-9c30-acd1a2ba4479 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052113 Sep 19 12:35:46.179066 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1585/3223] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:46.945673 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:46.946592 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:46.954168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:46.954658 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:46.955090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:46.955788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:46.956235 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:46.956661 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:47.087081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:47.094921 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ba7e647-0ca1-4f19-9b13-0f0e3c07fe65 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.153681 Sep 19 12:35:47.095531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1639/3224] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:46 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:48.120668 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:48.121370 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:48.127813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:48.128295 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:48.128735 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:48.129432 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:48.129950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:48.130408 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:48.264405 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:48.273511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2855849c-3709-4fe0-8c27-1336ffabf298 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.157654 Sep 19 12:35:48.274101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1586/3225] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:48 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:35:49.296667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:49.297264 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:49.304321 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:49.304815 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:49.305234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:49.305952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:49.306403 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:49.306823 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:49.310965 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:49.441536 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:49.449485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acfeb3ec-33bb-411a-9a49-9dc7274cf943 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.156662 Sep 19 12:35:49.450082 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1640/3226] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:49 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:50.472599 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:50.473284 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:50.480281 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:50.480764 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:50.481193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:50.481925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:50.482389 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:50.482780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:50.615114 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:50.626201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-74e0cda5-bfc6-4143-81b0-c54a7ecb671e tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.157421 Sep 19 12:35:50.630127 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1587/3227] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:50 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:51.650523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:51.651154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:51.653439 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:51.658848 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:51.659334 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:51.659765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:51.660462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:51.660909 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:51.661325 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:51.804044 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:51.811841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-84253a11-a271-4abf-a29b-9c65fa101ebd tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.165827 Sep 19 12:35:51.812413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1641/3228] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:51 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:52.393940 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-15bebceb-259b-4649-9618-bbd010d991b5 req-50b5f21b-5947-49b6-b8e1-42086005ef82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85737fc-d3e0-4533-88a6-453fc428769b", "name": "network-vif-plugged", "status": "completed", "tag": "6a7f23f8-7d14-46b6-adc6-d66505ee6f5a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:52.399469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:52.406154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-15bebceb-259b-4649-9618-bbd010d991b5 req-50b5f21b-5947-49b6-b8e1-42086005ef82 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:52.406643 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-15bebceb-259b-4649-9618-bbd010d991b5 req-50b5f21b-5947-49b6-b8e1-42086005ef82 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:52.407074 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-15bebceb-259b-4649-9618-bbd010d991b5 req-50b5f21b-5947-49b6-b8e1-42086005ef82 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:52.412635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:52.423126 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-15bebceb-259b-4649-9618-bbd010d991b5 req-50b5f21b-5947-49b6-b8e1-42086005ef82 service nova] Creating event network-vif-plugged:6a7f23f8-7d14-46b6-adc6-d66505ee6f5a for instance c85737fc-d3e0-4533-88a6-453fc428769b on hv-cinder-85829 Sep 19 12:35:52.429391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-15bebceb-259b-4649-9618-bbd010d991b5 req-50b5f21b-5947-49b6-b8e1-42086005ef82 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039110 Sep 19 12:35:52.430044 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1588/3229] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:52.836084 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:52.836678 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:52.842994 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:52.843464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:52.843889 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:52.844563 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:52.845005 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:52.845424 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:52.986111 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:52.993934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a46255fa-d838-4e8c-be8d-b4e506a3cd67 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.162438 Sep 19 12:35:52.994508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1642/3230] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:52 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:54.021488 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:54.022254 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:54.025793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:54.026654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=6 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:54.032468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:54.032963 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:54.033423 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:54.034165 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:54.034665 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:54.035092 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:54.176716 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:54.184931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-12251eb1-6f37-4eec-a97f-9a710fea0911 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1365 microversion: 2.1 time: 0.169240 Sep 19 12:35:54.185496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1589/3231] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:54 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:35:55.209911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:55.210521 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:55.212683 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:35:55.218517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:55.219101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:55.219531 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:55.220221 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:55.220668 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:55.221089 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:55.358618 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:35:55.367129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cbdd092-a3c1-4575-b487-c2f0bd3cb310 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1556 microversion: 2.1 time: 0.161220 Sep 19 12:35:55.367707 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1643/3232] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:35:55 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:35:55.389428 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:35:55.390149 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:35:55.397414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:55.397928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:55.398448 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:55.399098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:55.399555 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:55.399982 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:55.475617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c2fd7aa7-601b-4ca6-9d44-406cd750ca7a tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090042 Sep 19 12:35:55.476230 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1590/3233] 10.222.0.88 () {58 vars in 1275 bytes} [Mon Sep 19 12:35:55 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:35:56.679534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-cd15ac7a-0676-4ab8-b2e7-bac097d0d7c6 req-3d7aa9fe-a4c6-4914-ae10-957cdb0febfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85737fc-d3e0-4533-88a6-453fc428769b", "tag": "6a7f23f8-7d14-46b6-adc6-d66505ee6f5a"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:35:56.689090 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cd15ac7a-0676-4ab8-b2e7-bac097d0d7c6 req-3d7aa9fe-a4c6-4914-ae10-957cdb0febfd service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:35:56.689557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cd15ac7a-0676-4ab8-b2e7-bac097d0d7c6 req-3d7aa9fe-a4c6-4914-ae10-957cdb0febfd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:35:56.690020 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-cd15ac7a-0676-4ab8-b2e7-bac097d0d7c6 req-3d7aa9fe-a4c6-4914-ae10-957cdb0febfd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:35:56.702113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-cd15ac7a-0676-4ab8-b2e7-bac097d0d7c6 req-3d7aa9fe-a4c6-4914-ae10-957cdb0febfd service nova] Creating event network-changed:6a7f23f8-7d14-46b6-adc6-d66505ee6f5a for instance c85737fc-d3e0-4533-88a6-453fc428769b on hv-cinder-85829 Sep 19 12:35:56.707523 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-cd15ac7a-0676-4ab8-b2e7-bac097d0d7c6 req-3d7aa9fe-a4c6-4914-ae10-957cdb0febfd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032470 Sep 19 12:35:56.711240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1644/3234] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:06.126358 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=5 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:06.127134 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=11 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:06.131168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1474458405"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:06.131709 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:06.138510 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:06.139025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:06.139467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:06.140168 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:06.140623 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:06.141059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:06.273424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.network.security_group_api [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Removing security group 5da09471-d314-43f1-a6f1-d7ac705da700 from port 281525b4-1c2a-467c-a60b-d7baea87f0d0 Sep 19 12:36:06.597407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-62305b45-a27a-4518-b37b-958487db60d8 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/action" status: 202 len: 0 microversion: 2.1 time: 0.468619 Sep 19 12:36:06.597407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1591/3235] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 12:36:06 2022] POST /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:36:06.607188 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-19e62496-859c-4711-891f-404393bdc9cc req-6c937801-e6b9-412f-87e2-76a36ccb1d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9873a7-c419-445a-8399-72af1d68cdf9", "tag": "281525b4-1c2a-467c-a60b-d7baea87f0d0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:06.622324 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-19e62496-859c-4711-891f-404393bdc9cc req-6c937801-e6b9-412f-87e2-76a36ccb1d5e service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:06.623199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-19e62496-859c-4711-891f-404393bdc9cc req-6c937801-e6b9-412f-87e2-76a36ccb1d5e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:06.623869 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-19e62496-859c-4711-891f-404393bdc9cc req-6c937801-e6b9-412f-87e2-76a36ccb1d5e service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:06.636858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-19e62496-859c-4711-891f-404393bdc9cc req-6c937801-e6b9-412f-87e2-76a36ccb1d5e service nova] Creating event network-changed:281525b4-1c2a-467c-a60b-d7baea87f0d0 for instance 7e9873a7-c419-445a-8399-72af1d68cdf9 on hv-cinder-85829 Sep 19 12:36:06.642841 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-19e62496-859c-4711-891f-404393bdc9cc req-6c937801-e6b9-412f-87e2-76a36ccb1d5e service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041204 Sep 19 12:36:06.643754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1645/3236] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:07.777614 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:07.778187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:07.784595 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:07.785154 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:07.785672 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:07.786435 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:07.787468 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:07.787882 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:07.879029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.objects.instance [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lazy-loading 'services' on Instance uuid 7e9873a7-c419-445a-8399-72af1d68cdf9 {{(pid=120644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:36:07.959938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-892fcefb-27f1-4166-9c78-279e32fae1f7 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments/2fa6289d-5509-4118-a311-8e70e00b2178" status: 202 len: 0 microversion: 2.1 time: 0.186498 Sep 19 12:36:07.960590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1592/3237] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:36:07 2022] DELETE /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments/2fa6289d-5509-4118-a311-8e70e00b2178 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:36:07.971591 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:07.975174 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:07.981979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:07.982415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:07.982858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:07.983564 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:07.984007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:07.984462 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:08.018204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c01eae2-eb5a-411f-9425-b0f62162cc0c tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051651 Sep 19 12:36:08.018771 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1646/3238] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:36:07 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:08.667912 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-8fa74bfd-3cf3-4b77-8202-3b9ce2eaffc1 req-b876c0d8-3eac-4d63-9fba-892188f0586f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9873a7-c419-445a-8399-72af1d68cdf9", "tag": "281525b4-1c2a-467c-a60b-d7baea87f0d0"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:08.680178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8fa74bfd-3cf3-4b77-8202-3b9ce2eaffc1 req-b876c0d8-3eac-4d63-9fba-892188f0586f service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:08.680802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8fa74bfd-3cf3-4b77-8202-3b9ce2eaffc1 req-b876c0d8-3eac-4d63-9fba-892188f0586f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:08.681298 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-8fa74bfd-3cf3-4b77-8202-3b9ce2eaffc1 req-b876c0d8-3eac-4d63-9fba-892188f0586f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:08.701578 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-8fa74bfd-3cf3-4b77-8202-3b9ce2eaffc1 req-b876c0d8-3eac-4d63-9fba-892188f0586f service nova] Creating event network-changed:281525b4-1c2a-467c-a60b-d7baea87f0d0 for instance 7e9873a7-c419-445a-8399-72af1d68cdf9 on hv-cinder-85829 Sep 19 12:36:08.706933 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-8fa74bfd-3cf3-4b77-8202-3b9ce2eaffc1 req-b876c0d8-3eac-4d63-9fba-892188f0586f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045233 Sep 19 12:36:08.708155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1593/3239] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:09.031168 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:09.033338 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:09.040342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:09.040829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:09.041265 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:09.041985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:09.042438 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:09.042870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:09.071937 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a64d7262-93c5-45aa-84a2-a078e20983a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044735 Sep 19 12:36:09.077935 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1647/3240] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:36:09 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:36:09.083663 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:09.084279 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:09.091006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:09.091489 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:09.091928 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:09.092618 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:09.093077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:09.093506 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:09.168639 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] HTTP exception thrown: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 is not attached to volume 2fa6289d-5509-4118-a311-8e70e00b2178 Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Request method failure captured: Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments/2fa6289d-5509-4118-a311-8e70e00b2178 HTTP/1.1 Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGG_bUxP-NUQqCxgHf8GYY9pGK2u4Z7P-g-UTjSjZgukDh-JoRiViC8-sHw1CVYdvYBn7Ty8nBjdEtKEfKXYZVHHjq4RMLjQm-Nw6pNjnAIy0bljytQ9CJzy0P9ls8_-cVKRpoJ11IBf4rtHYi4ridnmYutxobvENh2iZYTbZ8ocziM Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0bfa97b89b0b4bdba0b64d6c2d1a58f9 Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-TestMinimumBasicScenario-2092679373 Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:36:09.171014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bfa97b89b0b4bdba0b64d6c2d1a58f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0bfa97b89b0b4bdba0b64d6c2d1a58f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bfa97b89b0b4bdba0b64d6c2d1a58f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0bfa97b89b0b4bdba0b64d6c2d1a58f9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-TestMinimumBasicScenario-2092679373 Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0bfa97b89b0b4bdba0b64d6c2d1a58f9 Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2092679373 Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-TestMinimumBasicScenario-2092679373-project Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 6e2db3de0da54265adb783c13c377704 Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-TestMinimumBasicScenario-2092679373-project Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:36:09.172344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 is not attached to volume 2fa6289d-5509-4118-a311-8e70e00b2178 Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'server_id': '7e9873a7-c419-445a-8399-72af1d68cdf9', 'id': '2fa6289d-5509-4118-a311-8e70e00b2178'} Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2fa6289d-5509-4118-a311-8e70e00b2178. Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:09.173047 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 is not attached to volume 2fa6289d-5509-4118-a311-8e70e00b2178 Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 is not attached to volume 2fa6289d-5509-4118-a311-8e70e00b2178 Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:09.174572 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Returning 404 to user: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 is not attached to volume 2fa6289d-5509-4118-a311-8e70e00b2178 {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:09.175529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f75e5813-0da8-4c78-a18d-8fe308bc64a1 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments/2fa6289d-5509-4118-a311-8e70e00b2178" status: 404 len: 154 microversion: 2.1 time: 0.093215 Sep 19 12:36:09.175529 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1594/3241] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:36:09 2022] DELETE /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9/os-volume_attachments/2fa6289d-5509-4118-a311-8e70e00b2178 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:10.314402 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:10.314900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:10.321797 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:10.322289 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:10.322724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:10.323409 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:10.323862 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:10.324286 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:10.349690 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:36:10.422435 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4999bf80-07a7-4bd2-a6fe-e2f0c4c2293d tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "DELETE /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 204 len: 0 microversion: 2.1 time: 0.111560 Sep 19 12:36:10.422938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1648/3242] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:36:10 2022] DELETE /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:36:10.431223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:10.431840 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:10.438262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:10.438747 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:10.439185 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:10.439876 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:10.440335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:10.440761 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:10.571779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:10.579486 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0bbb0bd4-44db-4f02-90c9-b0b9c7ee075b tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1552 microversion: 2.1 time: 0.152203 Sep 19 12:36:10.580050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1595/3243] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:10 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:11.604974 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:11.605603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:11.611886 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:11.612363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:11.612796 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:11.613477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:11.613962 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:11.614383 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:11.740753 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:11.748479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-610eaddb-69f6-489a-acfd-34dc62c48d08 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1552 microversion: 2.1 time: 0.147847 Sep 19 12:36:11.749045 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1649/3244] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:11 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:36:12.635155 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-0c10cfa9-c814-48ec-8443-913eba2b82bd req-a0558c5b-54d3-4d43-865a-80356219f112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9873a7-c419-445a-8399-72af1d68cdf9", "name": "network-vif-deleted", "tag": "281525b4-1c2a-467c-a60b-d7baea87f0d0"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:12.645452 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-0c10cfa9-c814-48ec-8443-913eba2b82bd req-a0558c5b-54d3-4d43-865a-80356219f112 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:12.646835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-0c10cfa9-c814-48ec-8443-913eba2b82bd req-a0558c5b-54d3-4d43-865a-80356219f112 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:12.647201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-0c10cfa9-c814-48ec-8443-913eba2b82bd req-a0558c5b-54d3-4d43-865a-80356219f112 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:12.659844 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-0c10cfa9-c814-48ec-8443-913eba2b82bd req-a0558c5b-54d3-4d43-865a-80356219f112 service nova] Creating event network-vif-deleted:281525b4-1c2a-467c-a60b-d7baea87f0d0 for instance 7e9873a7-c419-445a-8399-72af1d68cdf9 on hv-cinder-85829 Sep 19 12:36:12.664734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-0c10cfa9-c814-48ec-8443-913eba2b82bd req-a0558c5b-54d3-4d43-865a-80356219f112 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Sep 19 12:36:12.665503 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1596/3245] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:12.772398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:12.773010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:12.779371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:12.779843 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:12.780280 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:12.780971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:12.781445 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:12.781894 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:12.814477 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:12.814964 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:12.815400 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:12.815873 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lazy-loading 'fault' on Instance uuid 7e9873a7-c419-445a-8399-72af1d68cdf9 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:36:12.856785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2db3de0da54265adb783c13c377704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfa97b89b0b4bdba0b64d6c2d1a58f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:12.864605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a997841-fa58-45e3-aaef-7873c3a3b333 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 200 len: 1347 microversion: 2.1 time: 0.096825 Sep 19 12:36:12.865172 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1650/3246] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:12 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:13.887581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:13.888430 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] [instance: 7e9873a7-c419-445a-8399-72af1d68cdf9] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:13.894703 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:13.895194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:13.895637 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:13.896884 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:13.897344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:13.897790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:13.910654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] HTTP exception thrown: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 could not be found. Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Request method failure captured: Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 HTTP/1.1 Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGG_bUxP-NUQqCxgHf8GYY9pGK2u4Z7P-g-UTjSjZgukDh-JoRiViC8-sHw1CVYdvYBn7Ty8nBjdEtKEfKXYZVHHjq4RMLjQm-Nw6pNjnAIy0bljytQ9CJzy0P9ls8_-cVKRpoJ11IBf4rtHYi4ridnmYutxobvENh2iZYTbZ8ocziM Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 0bfa97b89b0b4bdba0b64d6c2d1a58f9 Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-TestMinimumBasicScenario-2092679373 Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:36:13.912947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bfa97b89b0b4bdba0b64d6c2d1a58f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/0bfa97b89b0b4bdba0b64d6c2d1a58f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/0bfa97b89b0b4bdba0b64d6c2d1a58f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_0bfa97b89b0b4bdba0b64d6c2d1a58f9", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-TestMinimumBasicScenario-2092679373 Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 0bfa97b89b0b4bdba0b64d6c2d1a58f9 Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2092679373 Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-TestMinimumBasicScenario-2092679373-project Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 6e2db3de0da54265adb783c13c377704 Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-TestMinimumBasicScenario-2092679373-project Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 could not be found. Sep 19 12:36:13.914420 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '7e9873a7-c419-445a-8399-72af1d68cdf9'} Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 could not be found. Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:13.915253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 could not be found. Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 could not be found. Sep 19 12:36:13.916617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:13.917932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Returning 404 to user: Instance 7e9873a7-c419-445a-8399-72af1d68cdf9 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:13.917932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-829954ff-a2c3-40f0-94ea-aefd12577459 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9" status: 404 len: 111 microversion: 2.1 time: 0.031460 Sep 19 12:36:13.917932 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1597/3247] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:13 2022] GET /compute/v2.1/servers/7e9873a7-c419-445a-8399-72af1d68cdf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:13.922859 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2212cd3c-4226-4e03-bb9e-d8c4d8815646 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] Calling method '.version_select at 0x7f4ff61a7700>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:13.942566 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2212cd3c-4226-4e03-bb9e-d8c4d8815646 tempest-TestMinimumBasicScenario-2092679373 tempest-TestMinimumBasicScenario-2092679373-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-204563884" status: 202 len: 0 microversion: 2.1 time: 0.023345 Sep 19 12:36:13.943130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1651/3248] 10.222.0.88 () {58 vars in 1269 bytes} [Mon Sep 19 12:36:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-204563884 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:36:31.607948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:31.609407 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:31.617864 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=14 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:31.618585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:31.620755 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:31.621446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:31.621927 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:31.622655 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:31.623118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:31.626744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:31.671441 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-2cd1ffd0-12bb-4e18-8c46-ef4fd032afe2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/ips" status: 200 len: 150 microversion: 2.1 time: 0.074541 Sep 19 12:36:31.679496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1598/3249] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 12:36:31 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/ips => generated 150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:31.825019 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:31.826430 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:32.079427 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-105e5551-8424-4d13-af50-f67e1a344c32 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Action: 'create', calling method: .version_select at 0x7f4ff9a02790>, body: {"keypair": {"name": "tempest-TestShelveInstance-41513703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIhNEEmTZbTQvX6PiPY0zM8Vd4/zQfwtTizMMMLFJvhUTIfmWNZCly6fVT5iRRTmnTm19aZ/916V/CrBl9Zh9U/xLLZL//Y14Kq74Oj3KHAqYkz57FavlOJUyrG+qM34w=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:32.111416 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-105e5551-8424-4d13-af50-f67e1a344c32 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Getting quotas for project 84a8601fd7bf4667a9b6901f6b4147cf. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:36:32.122337 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-105e5551-8424-4d13-af50-f67e1a344c32 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Getting quotas for user 49c6e6d0e00449eaabc76b1211ec8c43 and project 84a8601fd7bf4667a9b6901f6b4147cf. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:36:32.182490 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-105e5551-8424-4d13-af50-f67e1a344c32 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.366197 Sep 19 12:36:32.183092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1652/3250] 10.222.0.88 () {60 vars in 1159 bytes} [Mon Sep 19 12:36:31 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:33.171010 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "668ab15d-4f3b-4729-a710-105f1d278f44"}} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:33.173290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:33.181176 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:33.181662 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:33.182320 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:33.183026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:33.183475 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:33.183899 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:33.455023 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-8320b33a-1a0d-43ba-8f27-fc2a05460d2f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "POST /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287754 Sep 19 12:36:33.455779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1599/3251] 10.222.0.88 () {60 vars in 1323 bytes} [Mon Sep 19 12:36:33 2022] POST /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:41.127169 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:41.128434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:41.136535 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:41.137010 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:41.137434 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:41.138170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:41.138614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:41.139029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:41.322861 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lazy-loading 'services' on Instance uuid c85737fc-d3e0-4533-88a6-453fc428769b {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:36:41.397200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-016f5f4c-8e2d-4c9c-92d5-2141c582b4ce tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments/668ab15d-4f3b-4729-a710-105f1d278f44" status: 202 len: 0 microversion: 2.1 time: 0.274581 Sep 19 12:36:41.398095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1653/3252] 10.222.0.88 () {58 vars in 1416 bytes} [Mon Sep 19 12:36:41 2022] DELETE /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments/668ab15d-4f3b-4729-a710-105f1d278f44 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:36:41.408401 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:41.410596 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:41.418216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:41.418931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:41.419377 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:41.420076 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:41.420520 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:41.420939 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:41.458870 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c99e670f-5a7f-4c02-a039-bd61e99572d2 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056024 Sep 19 12:36:41.459607 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1600/3253] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:36:41 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:42.473131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:42.475529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:42.478099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:36:42.484120 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.484605 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.485041 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.485733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.486209 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.486629 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.515578 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c0d8e37-8a33-43a9-8eb8-e3db7d7719af tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047193 Sep 19 12:36:42.516128 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1654/3254] 10.222.0.88 () {58 vars in 1302 bytes} [Mon Sep 19 12:36:42 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:36:42.579930 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:42.580438 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:42.587449 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.587921 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.588349 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.589024 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.589467 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.589914 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.616834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Going to try to terminate instance {{(pid=120644) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:36:42.690241 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1f868cf3-690f-4456-9a23-799c9716d3e3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 204 len: 0 microversion: 2.1 time: 0.113528 Sep 19 12:36:42.691131 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1601/3255] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:36:42 2022] DELETE /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:36:42.701032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:42.701647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:42.707588 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.708070 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.708504 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.709195 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:42.709647 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:42.710102 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:42.841379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:42.849081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d94ddf43-489a-4d61-8565-1e382534f91c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1680 microversion: 2.1 time: 0.152107 Sep 19 12:36:42.849667 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1655/3256] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:42 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:43.872980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:43.874094 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:43.880118 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:43.880630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:43.881062 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:43.881745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:43.882216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:43.882638 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:44.011288 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:44.020159 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-ba865493-1eb4-4321-b20c-5103174e0682 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1680 microversion: 2.1 time: 0.151392 Sep 19 12:36:44.020766 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1602/3257] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:43 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:45.043904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:45.045115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:45.052616 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:45.053124 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:45.053550 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:45.055011 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:45.055468 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:45.055898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:45.128572 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4fd2deca6124518ae1df9ed7977f350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da2a386a837446dad4bf8b8506e418d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:45.138407 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63c0c47a-cd7f-4c92-97bc-df675d70f242 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 200 len: 1613 microversion: 2.1 time: 0.098451 Sep 19 12:36:45.139500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1656/3258] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:45 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 1613 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:45.176262 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-b0fb443f-b6e9-4aea-acb1-990e676db974 req-23be0ec6-7890-48df-b0fb-1fb9c1d3e17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85737fc-d3e0-4533-88a6-453fc428769b", "name": "network-vif-deleted", "tag": "6a7f23f8-7d14-46b6-adc6-d66505ee6f5a"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:45.188443 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b0fb443f-b6e9-4aea-acb1-990e676db974 req-23be0ec6-7890-48df-b0fb-1fb9c1d3e17f service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:45.188931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b0fb443f-b6e9-4aea-acb1-990e676db974 req-23be0ec6-7890-48df-b0fb-1fb9c1d3e17f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:45.189365 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-b0fb443f-b6e9-4aea-acb1-990e676db974 req-23be0ec6-7890-48df-b0fb-1fb9c1d3e17f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:45.201994 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-b0fb443f-b6e9-4aea-acb1-990e676db974 req-23be0ec6-7890-48df-b0fb-1fb9c1d3e17f service nova] Creating event network-vif-deleted:6a7f23f8-7d14-46b6-adc6-d66505ee6f5a for instance c85737fc-d3e0-4533-88a6-453fc428769b on hv-cinder-85829 Sep 19 12:36:45.209511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-b0fb443f-b6e9-4aea-acb1-990e676db974 req-23be0ec6-7890-48df-b0fb-1fb9c1d3e17f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126194 Sep 19 12:36:45.211196 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1603/3259] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:46.167954 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:46.168582 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:46.175173 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:46.175657 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:46.176085 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:46.176776 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:46.177256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:46.177674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:46.191322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b HTTP/1.1 Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:36:46.192957 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:46.194389 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'c85737fc-d3e0-4533-88a6-453fc428769b'} Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:46.196201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:46.197677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:46.199072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:46.199072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a030a54a-0574-4fbf-adde-cd82974bb813 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 404 len: 111 microversion: 2.1 time: 0.031178 Sep 19 12:36:46.199072 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1657/3260] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:46 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:46.205352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7d735781-9cc7-460e-a03b-68de50758775 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '.version_select at 0x7f4ff9985a60>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:46.224469 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7d735781-9cc7-460e-a03b-68de50758775 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-395683776" status: 202 len: 0 microversion: 2.1 time: 0.024173 Sep 19 12:36:46.225043 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1604/3261] 10.222.0.88 () {58 vars in 1218 bytes} [Mon Sep 19 12:36:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-395683776 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:36:47.992421 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:47.992888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:47.999273 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:47.999740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:48.000162 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:48.000835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:48.001279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:48.001692 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:48.014687 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b HTTP/1.1 Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:36:48.016200 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.017734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'c85737fc-d3e0-4533-88a6-453fc428769b'} Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:48.018814 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.020232 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.021947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:48.021947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96ced9c5-d08d-448e-80ab-3e977419d114 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 404 len: 111 microversion: 2.1 time: 0.029644 Sep 19 12:36:48.021947 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1658/3262] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:36:47 2022] DELETE /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:48.026527 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:48.027252 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: c85737fc-d3e0-4533-88a6-453fc428769b] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:48.033907 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:48.034393 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:48.034820 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:48.035494 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:48.035938 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:48.036354 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:48.049414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b HTTP/1.1 Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:36:48.051022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.052457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': 'c85737fc-d3e0-4533-88a6-453fc428769b'} Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:48.053269 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. Sep 19 12:36:48.055183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:48.056233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance c85737fc-d3e0-4533-88a6-453fc428769b could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:48.056233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7cb999bf-609e-48d3-80aa-aedd5b481e0f tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b" status: 404 len: 111 microversion: 2.1 time: 0.030166 Sep 19 12:36:48.056233 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1605/3263] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:48 2022] GET /compute/v2.1/servers/c85737fc-d3e0-4533-88a6-453fc428769b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:48.555363 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-250770156", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-41513703", "security_groups": [{"name": "tempest-secgroup-smoke-1941963379"}], "networks": [{"uuid": "77fe1dc6-445c-4560-a1c0-2e54aeb8d573"}], "block_device_mapping_v2": [{"uuid": "e16e6bf1-e905-41b9-9325-db6cad1f5033", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:48.667611 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] validate_networks() for [('77fe1dc6-445c-4560-a1c0-2e54aeb8d573', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:36:49.046279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:36:49.046874 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:36:49.047152 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:36:49.047557 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:36:49.047967 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:36:49.056706 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.057182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.057612 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.058370 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.058820 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.059240 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.076542 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Getting quotas for project 84a8601fd7bf4667a9b6901f6b4147cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:36:49.080514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Getting quotas for user 49c6e6d0e00449eaabc76b1211ec8c43 and project 84a8601fd7bf4667a9b6901f6b4147cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:36:49.140426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:36:49.142615 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e16e6bf1-e905-41b9-9325-db6cad1f5033',volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:36:49.189201 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:49.189746 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:49.196213 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.196981 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.197424 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.198210 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.198777 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.199187 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.213439 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a HTTP/1.1 Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:36:49.215011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.216593 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '53ed39b8-ddb1-4468-928d-41cf1c0a301a'} Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:49.217492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.218936 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.220306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:49.220306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-b3b60694-f59a-44af-88e2-52cc03dd034d tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 404 len: 111 microversion: 2.1 time: 0.031302 Sep 19 12:36:49.220306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1606/3264] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:36:49 2022] DELETE /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:36:49.228450 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:49.229199 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 53ed39b8-ddb1-4468-928d-41cf1c0a301a] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:49.235038 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.235534 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.235964 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.236659 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.237113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.237539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.250803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a HTTP/1.1 Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:36:49.252306 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.253846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '53ed39b8-ddb1-4468-928d-41cf1c0a301a'} Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:49.254763 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. Sep 19 12:36:49.256346 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.258462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 53ed39b8-ddb1-4468-928d-41cf1c0a301a could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:49.258462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-192d3bf3-e96b-424f-95af-6eeebb86dd72 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a" status: 404 len: 111 microversion: 2.1 time: 0.029064 Sep 19 12:36:49.258462 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1607/3265] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:49 2022] GET /compute/v2.1/servers/53ed39b8-ddb1-4468-928d-41cf1c0a301a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:36:49.262193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:49.262687 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:49.269093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.269575 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.270097 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.270806 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.271261 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.271682 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.284619 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2c9d17c-a9e3-4160-8262-a1d426d32466 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733035 Sep 19 12:36:49.285058 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.292211 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1659/3266] 10.222.0.88 () {60 vars in 1147 bytes} [Mon Sep 19 12:36:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 HTTP/1.1 Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:36:49.292353 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.293594 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '9cf3654a-8922-41bf-ac33-580481e66074'} Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:49.294394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.295566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.297077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:49.297077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-423acd6b-5fd1-49f4-8e60-699149514070 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 404 len: 111 microversion: 2.1 time: 0.029308 Sep 19 12:36:49.297077 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1608/3267] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:36:49 2022] DELETE /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:49.297459 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-afeecd67-d55e-4084-bc3e-19bde4d9cd44 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:49.297600 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:49.297743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-afeecd67-d55e-4084-bc3e-19bde4d9cd44 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:49.298113 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 9cf3654a-8922-41bf-ac33-580481e66074] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:49.306115 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.306603 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.307038 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.307773 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:49.308256 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:49.308714 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:49.324234 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 HTTP/1.1 Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:36:49.325821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.327095 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '9cf3654a-8922-41bf-ac33-580481e66074'} Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:49.327832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. Sep 19 12:36:49.329457 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:49.331301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 9cf3654a-8922-41bf-ac33-580481e66074 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:49.331301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cede25ba-6469-49e9-9aab-6358d3d81c6c tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074" status: 404 len: 111 microversion: 2.1 time: 0.033968 Sep 19 12:36:49.331301 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1660/3268] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:49 2022] GET /compute/v2.1/servers/9cf3654a-8922-41bf-ac33-580481e66074 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:36:49.362318 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-afeecd67-d55e-4084-bc3e-19bde4d9cd44 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:49.371553 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-afeecd67-d55e-4084-bc3e-19bde4d9cd44 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1086 microversion: 2.1 time: 0.078105 Sep 19 12:36:49.372050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1609/3269] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:49 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1086 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:50.395858 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:50.396503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:50.403391 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:50.403811 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:50.404249 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:50.404940 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:50.405392 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:50.405846 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:50.476597 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:50.482583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:50.483636 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:50.484574 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1806a2e5-5512-4fdc-810b-d35cf4af9071 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1202 microversion: 2.1 time: 0.092675 Sep 19 12:36:50.485129 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1661/3270] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:50 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:50.491255 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:50.492343 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:50.493022 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:50.494003 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:50.495604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:50.495604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:50.511162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: DELETE /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 HTTP/1.1 Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:36:50.512842 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.514208 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '4013ca3a-af58-4992-a620-6089699f6c35'} Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:50.514945 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.516480 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.517968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:50.517968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-1829d4e2-5527-43c3-acdc-8d5f0174ec40 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "DELETE /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 404 len: 111 microversion: 2.1 time: 0.035635 Sep 19 12:36:50.517968 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1610/3271] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:36:50 2022] DELETE /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:50.523398 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:50.523999 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] [instance: 4013ca3a-af58-4992-a620-6089699f6c35] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:50.529981 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:50.530458 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:50.530879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:50.531555 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:50.531997 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:50.532414 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:50.546724 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] HTTP exception thrown: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Request method failure captured: Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 HTTP/1.1 Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.88 Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjKGFTHyR5ZG_mKbjOhceRShvtMN1GGNjWPhnskrZE9-3tlp24iEWmH8xRZ_btGjyidRIZw2pV6E2HZqxXXjAiMuw7F6CFH9bv2YKTV8UNnhpYT1lu4dMVAV4WWBzesQ_wmmczEVeB9KsSolOyMaTXkvUVKiSL9H-PYadgOpNX1QkwBfM Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Role: reader,member Sep 19 12:36:50.548132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Roles: reader,member Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/3da2a386a837446dad4bf8b8506e418d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_3da2a386a837446dad4bf8b8506e418d", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 3da2a386a837446dad4bf8b8506e418d Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1715299585 Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Id: f4fd2deca6124518ae1df9ed7977f350 Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-1715299585-project Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: method: > Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: exception: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.549456 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '4013ca3a-af58-4992-a620-6089699f6c35'} Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:36:50.550251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. Sep 19 12:36:50.551401 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 19 12:36:50.552415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] Returning 404 to user: Instance 4013ca3a-af58-4992-a620-6089699f6c35 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:36:50.552415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1a6636b-b6e6-4fb7-ba04-8d76bfbd73c3 tempest-AttachVolumeNegativeTest-1715299585 tempest-AttachVolumeNegativeTest-1715299585-project] 10.222.0.88 "GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35" status: 404 len: 111 microversion: 2.1 time: 0.029993 Sep 19 12:36:50.552415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1662/3272] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:50 2022] GET /compute/v2.1/servers/4013ca3a-af58-4992-a620-6089699f6c35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:36:51.508454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:51.509674 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:51.516525 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:51.517078 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:51.517519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:51.518308 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:51.518760 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:51.519359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:51.738517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-5971c2e4-cba6-4fdf-8c2c-c2c43b8ce4bc req-6b78ed7d-50a6-4ffd-9723-27ce9a1da56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f73bf3-5727-4433-af9a-3e74fc2fda65", "tag": "54847a88-94ca-45c7-910a-5fc6ab919b38"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:36:51.755508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5971c2e4-cba6-4fdf-8c2c-c2c43b8ce4bc req-6b78ed7d-50a6-4ffd-9723-27ce9a1da56d service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:51.755986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5971c2e4-cba6-4fdf-8c2c-c2c43b8ce4bc req-6b78ed7d-50a6-4ffd-9723-27ce9a1da56d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:51.756415 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5971c2e4-cba6-4fdf-8c2c-c2c43b8ce4bc req-6b78ed7d-50a6-4ffd-9723-27ce9a1da56d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:51.776476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-5971c2e4-cba6-4fdf-8c2c-c2c43b8ce4bc req-6b78ed7d-50a6-4ffd-9723-27ce9a1da56d service nova] Creating event network-changed:54847a88-94ca-45c7-910a-5fc6ab919b38 for instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 on hv-cinder-85829 Sep 19 12:36:51.781655 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-5971c2e4-cba6-4fdf-8c2c-c2c43b8ce4bc req-6b78ed7d-50a6-4ffd-9723-27ce9a1da56d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046785 Sep 19 12:36:51.782454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1663/3273] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:36:51.988498 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:51.997790 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c205949e-d8a3-4ce1-97e5-65b473a79ed9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.493214 Sep 19 12:36:51.998581 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1611/3274] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:51 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:53.023583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:53.024279 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:53.030900 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:53.031722 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:53.032399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:53.033194 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:53.033835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:53.034318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:53.250520 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:53.258829 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e398bbf-1764-41d4-9cbc-5d8a790123a6 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.239791 Sep 19 12:36:53.259214 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1664/3275] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:53 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:54.282931 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:54.284193 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:54.291846 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:54.292325 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:54.292925 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:54.293803 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:54.294263 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:54.294704 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:54.438902 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:54.447128 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-57d58235-4b51-4a11-a9ad-125a0df19076 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.168957 Sep 19 12:36:54.447678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1612/3276] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:54 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:55.471052 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:55.471839 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:55.479119 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:55.479610 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:55.480047 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:55.480734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:55.481189 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:55.481614 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:55.613518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:55.621850 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1e6cfbf-19c1-4d05-b2e1-e74ac1f8bd60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.154533 Sep 19 12:36:55.622432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1665/3277] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:55 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:56.644564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:56.645178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:56.651570 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:56.652059 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:56.652521 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:56.653188 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:56.653646 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:56.654101 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:56.786834 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:56.794950 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-20995777-e8e4-4f40-af37-08b64c6eddbd tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.154326 Sep 19 12:36:56.795519 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1613/3278] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:56 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:57.818154 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:57.818755 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:57.825717 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:57.826231 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:57.826663 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:57.827339 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:57.827788 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:57.828207 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:57.957971 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:57.965865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-201eb90c-0e99-4a35-8306-0d81082cb776 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.151525 Sep 19 12:36:57.966432 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1666/3279] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:57 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:36:58.988111 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:36:58.988743 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:36:58.995712 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:58.996191 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:58.996617 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:58.997587 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:36:58.998207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:36:58.998797 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:36:59.145108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:36:59.153338 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-97c07b46-c2fc-424d-9d69-3ff5642d704d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.169064 Sep 19 12:36:59.154032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1614/3280] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:36:58 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:00.176831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:00.177515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:00.180304 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:00.180963 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:00.187208 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:00.187685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:00.188110 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:00.188793 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:00.189259 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:00.189677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:00.323778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:00.331558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1aae7408-5829-4283-8f87-44168716a7a3 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.158626 Sep 19 12:37:00.332114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1667/3281] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:00 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:01.355274 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:01.355879 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:01.357862 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell0:SELECT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:01.373630 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:01.374142 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:01.374577 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:01.375265 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:01.375714 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:01.376132 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:01.515258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:01.523604 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7c888229-d168-445a-9fec-beec632ea8d2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.172053 Sep 19 12:37:01.524177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1615/3282] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:01 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:02.546130 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:02.546764 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:02.549009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:02.554508 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:02.554985 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:02.555413 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:02.556093 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:02.556539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:02.556952 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:02.560396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:02.704220 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:02.713242 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbdab156-2fd1-4bc9-bd8e-996166ed4126 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.170851 Sep 19 12:37:02.713845 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1668/3283] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:02 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:02.770848 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-6ff19997-4ef4-4125-8202-795f5fbe2be1 req-80276fa5-793b-4402-977c-cc35aeb6006f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f73bf3-5727-4433-af9a-3e74fc2fda65", "name": "network-vif-plugged", "status": "completed", "tag": "54847a88-94ca-45c7-910a-5fc6ab919b38"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:37:02.776713 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:02.784796 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6ff19997-4ef4-4125-8202-795f5fbe2be1 req-80276fa5-793b-4402-977c-cc35aeb6006f service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:02.785361 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6ff19997-4ef4-4125-8202-795f5fbe2be1 req-80276fa5-793b-4402-977c-cc35aeb6006f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:02.785890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-6ff19997-4ef4-4125-8202-795f5fbe2be1 req-80276fa5-793b-4402-977c-cc35aeb6006f service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:02.798447 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-6ff19997-4ef4-4125-8202-795f5fbe2be1 req-80276fa5-793b-4402-977c-cc35aeb6006f service nova] Creating event network-vif-plugged:54847a88-94ca-45c7-910a-5fc6ab919b38 for instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 on hv-cinder-85829 Sep 19 12:37:02.803616 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-6ff19997-4ef4-4125-8202-795f5fbe2be1 req-80276fa5-793b-4402-977c-cc35aeb6006f service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036614 Sep 19 12:37:02.804817 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1616/3284] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:37:03.737284 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:03.737924 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:03.751799 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:03.752293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:03.752733 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:03.753440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:03.753919 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:03.754345 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:03.889342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:03.897105 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad667664-c49a-4c0b-943b-176d40d06919 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1258 microversion: 2.1 time: 0.164860 Sep 19 12:37:03.897888 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1669/3285] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:03 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:04.920739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:04.921582 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:04.927990 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:04.928473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:04.928898 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:04.930229 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:04.930890 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:04.931293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:04.933988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:37:05.076700 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:05.085050 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0be51ce4-080a-4dac-bca5-2f353446fe8e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1442 microversion: 2.1 time: 0.168709 Sep 19 12:37:05.085892 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1617/3286] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:04 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:05.109514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:37:05.110384 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:37:05.117405 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:05.117934 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:05.118371 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:05.119063 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:05.119515 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:05.119936 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:05.266471 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:37:05.284870 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae14d3f2-d64c-46c0-b677-1470d0222f5e tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1442 microversion: 2.1 time: 0.180489 Sep 19 12:37:05.285382 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1670/3287] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:37:05 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1442 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:37:07.293009 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-01af1059-07d5-4869-9297-ac3dd8be3526 req-c9f4ad88-cded-4b82-a80f-96ca32ca4a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f73bf3-5727-4433-af9a-3e74fc2fda65", "tag": "54847a88-94ca-45c7-910a-5fc6ab919b38"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:37:07.302721 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-01af1059-07d5-4869-9297-ac3dd8be3526 req-c9f4ad88-cded-4b82-a80f-96ca32ca4a8c service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:37:07.303205 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-01af1059-07d5-4869-9297-ac3dd8be3526 req-c9f4ad88-cded-4b82-a80f-96ca32ca4a8c service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:37:07.303757 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-01af1059-07d5-4869-9297-ac3dd8be3526 req-c9f4ad88-cded-4b82-a80f-96ca32ca4a8c service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:37:07.315240 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-01af1059-07d5-4869-9297-ac3dd8be3526 req-c9f4ad88-cded-4b82-a80f-96ca32ca4a8c service nova] Creating event network-changed:54847a88-94ca-45c7-910a-5fc6ab919b38 for instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 on hv-cinder-85829 Sep 19 12:37:07.320178 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-01af1059-07d5-4869-9297-ac3dd8be3526 req-c9f4ad88-cded-4b82-a80f-96ca32ca4a8c service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031282 Sep 19 12:37:07.320741 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1618/3288] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:39:06.373352 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=5 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:06.374131 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=17 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:06.379968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:06.380496 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:06.387156 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:06.387637 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:06.388071 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:06.388754 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:06.389206 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:06.389628 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:06.412925 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lazy-loading 'flavor' on Instance uuid 16f73bf3-5727-4433-af9a-3e74fc2fda65 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:39:06.523713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8825d14b-58f4-4d9f-a025-b49b4896efbe tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "POST /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65/action" status: 202 len: 0 microversion: 2.1 time: 0.151860 Sep 19 12:39:06.524282 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1671/3289] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 12:39:06 2022] POST /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:39:06.530872 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef1fc493-fee7-4cfa-a593-3727931afed4] AMQP server on 10.222.0.88:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 19 12:39:06.531511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=5 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:06.532177 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=7 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:06.534032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:39:06.534032 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 (ip 10.222.0.88) !!! Sep 19 12:39:06.539335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:06.540694 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:06.550153 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:06.550658 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:06.551095 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:06.551793 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:06.552251 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:06.552678 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:06.688798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:06.696444 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-5589ff51-5680-4889-b415-311b34b138cb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.167574 Sep 19 12:39:06.697011 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1619/3290] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:06 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:07.720164 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:07.720854 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:07.726905 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:07.727378 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:07.727805 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:07.728479 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:07.728920 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:07.729336 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:07.858016 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:07.865685 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-786a7078-f9b2-4c4e-b4c1-65897fedb7ee tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.150347 Sep 19 12:39:07.866281 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1672/3291] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:07 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:08.888750 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:08.889359 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:08.897335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:08.897836 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:08.898267 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:08.898947 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:08.899391 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:08.899812 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:08.905014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef1fc493-fee7-4cfa-a593-3727931afed4] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 57734. Sep 19 12:39:09.028340 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:09.036566 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fbd11bf5-fe0e-4357-9063-95226a36050b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.151710 Sep 19 12:39:09.037122 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1620/3292] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:08 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:10.060482 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:10.061092 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:10.067984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:10.068464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:10.068898 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:10.069583 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:10.070061 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:10.070489 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:10.210691 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:10.218241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4aca7631-b003-4b39-89b5-1e942fa83525 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.161663 Sep 19 12:39:10.218801 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1673/3293] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:10 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:11.242411 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:11.243048 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:11.250317 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:11.250802 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:11.251234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:11.251922 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:11.252371 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:11.252791 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:11.379779 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:11.387455 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-c944a55f-2b00-40f9-8896-cf65bccd6fcf tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.148925 Sep 19 12:39:11.388014 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1621/3294] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:11 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:12.411125 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:12.411664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:12.418029 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:12.418510 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:12.418943 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:12.419631 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:12.420081 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:12.420500 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:12.551688 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:12.559448 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6faf8f4f-3d11-46e0-b049-eb9cea484d03 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.152332 Sep 19 12:39:12.560009 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1674/3295] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:12 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:13.582342 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:13.582951 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:13.589573 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:13.590093 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:13.590531 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:13.591220 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:13.591681 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:13.592107 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:13.722307 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:13.729956 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-38380c42-246c-46a7-811e-4312c76f7609 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.151795 Sep 19 12:39:13.730518 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1622/3296] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:13 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:14.753713 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:14.754341 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:14.761030 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:14.761505 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:14.761979 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:14.762672 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:14.763132 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:14.763558 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:14.891364 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:14.899534 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04d08d7d-f37e-4822-8e11-ad60295c291f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.149675 Sep 19 12:39:14.900097 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1675/3297] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:14 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:15.924091 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:15.924697 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:15.931031 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:15.931511 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:15.931946 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:15.932627 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:15.933075 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:15.933492 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:16.065223 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:16.073216 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f1a618fe-bd66-4f46-940e-298ad2996176 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.153556 Sep 19 12:39:16.073813 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1623/3298] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:15 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:17.097287 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:17.097926 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:17.104098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:17.104577 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:17.105007 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:17.105689 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:17.106178 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:17.106599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:17.235026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:17.242710 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bb8e9a8-191e-44c3-863e-45b19ce3bede tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.149965 Sep 19 12:39:17.243270 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1676/3299] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:17 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:39:18.266649 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:18.267256 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:18.273654 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:18.274183 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:18.274611 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:18.275290 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:18.275734 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:18.276148 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:18.587016 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:18.595090 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-350f986c-323d-4dbe-93bc-556e96e64519 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.332884 Sep 19 12:39:18.595666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1624/3300] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:18 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:19.619118 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:19.619727 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:19.626736 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:19.627212 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:19.627640 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:19.628318 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:19.628765 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:19.629180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:19.761342 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:19.769258 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bcb23a5-8a02-469c-8d37-323ffcf4bb60 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.153973 Sep 19 12:39:19.769835 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1677/3301] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:19 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:20.792026 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:20.792635 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:20.799603 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:20.800085 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:20.800541 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:20.801209 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:20.801661 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:20.802113 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:20.931471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:20.939934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-0938fa0f-3d54-4a62-bf9b-add5ce31a68d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.151814 Sep 19 12:39:20.940496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1625/3302] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:20 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:21.963417 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:21.964026 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:21.971114 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:21.971744 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:21.972187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:21.972880 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:21.973332 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:21.973781 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:22.103606 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:22.112080 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a94d8e5-dd0c-4956-9eae-01c0cfb507ab tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.152804 Sep 19 12:39:22.112652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1678/3303] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:21 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:23.135417 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:23.136025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:23.142988 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:23.143466 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:23.143895 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:23.144585 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:23.145029 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:23.145446 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:23.273258 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:23.281471 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6bdb3acd-60c2-4019-8c21-cc7e187806f5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.149905 Sep 19 12:39:23.282061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1626/3304] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:23 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:24.304328 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:24.304939 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:24.311449 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:24.311918 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:24.312354 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:24.313039 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:24.313494 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:24.313950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:24.451911 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:24.459847 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52656806-08ce-4793-900c-4c11d94f40af tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.159268 Sep 19 12:39:24.460664 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1679/3305] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:24 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:25.484257 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:25.484799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:25.491146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:25.491624 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:25.492051 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:25.492732 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:25.493174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:25.493590 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:25.625745 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:25.633473 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-fd03c81f-003d-4b13-8d93-da8a05a4df0c tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1508 microversion: 2.1 time: 0.153221 Sep 19 12:39:25.634065 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1627/3306] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:25 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:25.656718 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:25.657310 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:25.663734 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:25.664215 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:25.664646 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:25.665327 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:25.665795 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:25.666217 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:25.753986 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 12:39:25.817613 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [92efe43b-463a-409d-bb7a-62ffe2acc55c] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:39:26.824098 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [92efe43b-463a-409d-bb7a-62ffe2acc55c] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 57784. Sep 19 12:39:26.828201 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9d3e25c-49d3-4531-8f4c-fd62fe5f089b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "POST /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65/action" status: 202 len: 0 microversion: 2.1 time: 1.176131 Sep 19 12:39:26.828825 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1680/3307] 10.222.0.88 () {60 vars in 1278 bytes} [Mon Sep 19 12:39:25 2022] POST /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65/action => generated 0 bytes in 1177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:39:26.837197 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:26.837819 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:26.844730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:26.845207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:26.845633 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:26.846352 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:26.846799 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:26.847217 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:26.996167 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:27.004383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-649af887-afc5-49dd-a1c8-0a90dbe3ef20 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1516 microversion: 2.1 time: 0.171335 Sep 19 12:39:27.004954 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1628/3308] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:26 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:27.396180 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-7ac1a956-8b00-4e14-a6e8-7e1ff9d706e5 req-dd7c26d8-f1dd-48d8-9e96-0b03bbf922fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f73bf3-5727-4433-af9a-3e74fc2fda65", "name": "network-vif-unplugged", "status": "completed", "tag": "54847a88-94ca-45c7-910a-5fc6ab919b38"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:27.412485 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7ac1a956-8b00-4e14-a6e8-7e1ff9d706e5 req-dd7c26d8-f1dd-48d8-9e96-0b03bbf922fd service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:27.413145 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7ac1a956-8b00-4e14-a6e8-7e1ff9d706e5 req-dd7c26d8-f1dd-48d8-9e96-0b03bbf922fd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:27.413607 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-7ac1a956-8b00-4e14-a6e8-7e1ff9d706e5 req-dd7c26d8-f1dd-48d8-9e96-0b03bbf922fd service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:27.425503 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.compute.server_external_events [req-7ac1a956-8b00-4e14-a6e8-7e1ff9d706e5 req-dd7c26d8-f1dd-48d8-9e96-0b03bbf922fd service nova] Unable to find a host for instance 16f73bf3-5727-4433-af9a-3e74fc2fda65. Dropping event network-vif-unplugged {{(pid=120643) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 12:39:27.426393 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-7ac1a956-8b00-4e14-a6e8-7e1ff9d706e5 req-dd7c26d8-f1dd-48d8-9e96-0b03bbf922fd service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.105143 Sep 19 12:39:27.426968 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1681/3309] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 106 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 12:39:28.029104 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:28.029788 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:28.037146 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:28.037690 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:28.038179 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:28.039069 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:28.039554 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:28.039980 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:28.178108 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:28.185967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f27fc279-8829-49ad-8423-ce9ad34a6476 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1518 microversion: 2.1 time: 0.161241 Sep 19 12:39:28.186539 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1629/3310] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:28 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:29.209993 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:29.210882 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:29.217223 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:29.218454 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:29.218895 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:29.219580 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:29.220037 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:29.220463 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:29.357464 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:29.365269 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d41c6242-86f0-40f8-ab22-c68cdb60debc tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.159323 Sep 19 12:39:29.365852 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1682/3311] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:29 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:30.388259 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:30.388860 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:30.395363 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:30.395835 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:30.396293 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:30.396972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:30.397474 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:30.397866 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:30.526669 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:30.534789 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-827f2700-3478-4aeb-a290-d7272a55e694 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.150355 Sep 19 12:39:30.535360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1630/3312] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:30 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:31.558182 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:31.558782 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:31.565053 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:31.565528 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:31.565996 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:31.566681 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:31.567183 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:31.567599 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:31.699721 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:31.707978 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3889a8a-28ae-4435-8267-bf72532bb0c0 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.153667 Sep 19 12:39:31.708541 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1683/3313] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:31 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:32.731234 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:32.731859 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:32.738774 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:32.739253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:32.739680 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:32.740383 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:32.740829 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:32.741243 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:32.870030 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:32.878106 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-7f607215-b07b-4518-9806-b04e45eb45e5 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.150651 Sep 19 12:39:32.878871 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1631/3314] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:32 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:33.901594 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:33.902222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:33.909276 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:33.909758 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:33.910222 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:33.910904 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:33.911355 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:33.911778 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:34.038865 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:34.046547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fee5c4f8-52c3-4666-a6a2-1810132377ff tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.148813 Sep 19 12:39:34.047112 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1684/3315] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:33 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:35.070151 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:35.070780 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:35.077569 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:35.078084 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:35.078514 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:35.079194 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:35.079651 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:35.080064 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:35.211536 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:35.219811 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-76d73871-236d-49b1-a9f2-6be5608e2f83 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.153547 Sep 19 12:39:35.220376 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1632/3316] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:35 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:36.242831 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:36.243440 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:36.249912 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:36.250396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:36.250833 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:36.251518 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:36.251973 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:36.252396 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:36.256491 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:36.384399 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:36.392058 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edb19d61-0f8f-4658-8a3d-217565791a58 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.153163 Sep 19 12:39:36.392626 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1685/3317] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:36 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:37.415620 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:37.416341 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:37.419052 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=29 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:37.424972 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:37.425454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:37.425920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:37.426615 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:37.427067 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:37.427490 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:37.430394 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=85 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:37.564708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:37.572496 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f54b6caf-2291-487a-907c-61da597e3433 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.160944 Sep 19 12:39:37.573061 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1633/3318] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:37 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:38.596879 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:38.597476 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:38.599867 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:39:38.605419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:38.605941 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:38.606379 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:38.607101 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:38.607556 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:38.608632 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:38.739046 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:38.746677 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2dc26d46-dbf5-4572-ae47-21419e23b970 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.153644 Sep 19 12:39:38.747241 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1686/3319] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:38 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:39.422253 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f73bf3-5727-4433-af9a-3e74fc2fda65", "name": "network-vif-plugged", "status": "completed", "tag": "54847a88-94ca-45c7-910a-5fc6ab919b38"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:39:39.431758 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:39.432283 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:39.432708 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:39.443720 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] Creating event network-vif-plugged:54847a88-94ca-45c7-910a-5fc6ab919b38 for instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 on hv-cinder-85829 Sep 19 12:39:39.447164 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR oslo.messaging._drivers.impl_rabbit [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] [d47fb8ce-a898-4ed6-9b96-b777e15ba91e] AMQP server on 10.222.0.88:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:39:39.769704 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:39.770361 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:39.776674 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:39.777153 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:39.777585 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:39.778293 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:39.778740 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:39.779187 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:39.906369 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:39.913970 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68c09d38-75aa-41ab-a108-f0cf5c0905eb tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.148063 Sep 19 12:39:39.914529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1687/3320] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:39 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:39:40.454457 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] [d47fb8ce-a898-4ed6-9b96-b777e15ba91e] Reconnected to AMQP server on 10.222.0.88:5672 via [amqp] client with port 57842. Sep 19 12:39:40.457685 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-a99b1db0-89d4-4be0-b4fe-d4f9cab7a362 req-f9d4ae37-426e-4633-a3d3-f3a9c4c8ce4a service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040073 Sep 19 12:39:40.458334 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1634/3321] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:39:40.936547 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:40.938887 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:40.944032 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:40.944517 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:40.944950 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:40.945638 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:40.946117 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:40.946537 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:41.079529 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:41.087386 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44cfea22-6a82-41e6-a59e-d9b8dd5a2f6f tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1574 microversion: 2.1 time: 0.154685 Sep 19 12:39:41.087955 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1688/3322] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:40 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:39:42.111454 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:39:42.112157 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:39:42.118344 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:42.118828 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:42.119268 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:42.119957 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:39:42.120414 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:39:42.120841 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:39:42.247967 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:39:42.256119 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-f9def20d-4cdc-4e5b-b720-a6d894ee990d tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1561 microversion: 2.1 time: 0.149346 Sep 19 12:39:42.256689 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1635/3323] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:39:42 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:40:58.871447 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:58.872299 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:58.872666 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-3e18a28c-2644-4f38-8ef4-5632a1415ec1 req-ab3f3038-e9b9-4b69-95c6-42a6a001c56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f73bf3-5727-4433-af9a-3e74fc2fda65", "tag": "54847a88-94ca-45c7-910a-5fc6ab919b38"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:40:58.875099 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=5 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:58.875844 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=22 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:58.877838 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:40:58.878017 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: Mon Sep 19 12:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 (ip 10.222.0.88) !!! Sep 19 12:40:58.881025 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_api:SELECT=5 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:58.881934 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG dbcounter [-] [120644] Writing DB stats nova_cell1:SELECT=13 {{(pid=120644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:40:58.882739 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:40:58.883138 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Mon Sep 19 12:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.88) !!! Sep 19 12:40:58.889335 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3e18a28c-2644-4f38-8ef4-5632a1415ec1 req-ab3f3038-e9b9-4b69-95c6-42a6a001c56d service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:58.889920 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3e18a28c-2644-4f38-8ef4-5632a1415ec1 req-ab3f3038-e9b9-4b69-95c6-42a6a001c56d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:58.890583 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-3e18a28c-2644-4f38-8ef4-5632a1415ec1 req-ab3f3038-e9b9-4b69-95c6-42a6a001c56d service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:58.901679 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:58.902204 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:58.902633 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:58.903329 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:58.903777 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:58.903909 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-3e18a28c-2644-4f38-8ef4-5632a1415ec1 req-ab3f3038-e9b9-4b69-95c6-42a6a001c56d service nova] Creating event network-changed:54847a88-94ca-45c7-910a-5fc6ab919b38 for instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 on hv-cinder-85829 Sep 19 12:40:58.904190 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:58.911174 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-3e18a28c-2644-4f38-8ef4-5632a1415ec1 req-ab3f3038-e9b9-4b69-95c6-42a6a001c56d service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042730 Sep 19 12:40:58.912330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1636/3324] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:40:58.937652 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:40:59.019584 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce1dc0ce-8741-4fd1-a0c4-6c5537116ec2 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "DELETE /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 204 len: 0 microversion: 2.1 time: 0.153179 Sep 19 12:40:59.023488 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1689/3325] 10.222.0.88 () {58 vars in 1239 bytes} [Mon Sep 19 12:40:58 2022] DELETE /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:40:59.032948 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:40:59.033798 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:40:59.041190 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:59.041784 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:59.042360 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:59.043162 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:40:59.043717 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:40:59.044357 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:40:59.188855 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.policy [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120644) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:40:59.197207 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-6645e71b-cc7a-49a8-9ed9-bdd6e5855849 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.169188 Sep 19 12:40:59.197792 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1637/3326] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:40:59 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:41:00.221083 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:41:00.221804 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:41:00.228539 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:00.229021 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:00.229785 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:00.230486 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:00.230938 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:00.231357 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:00.360821 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:41:00.368426 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa546031-e297-482e-bf85-584549eeb427 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1567 microversion: 2.1 time: 0.151653 Sep 19 12:41:00.368984 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1690/3327] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:41:00 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:41:00.983098 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [req-25eabf18-1e3b-4fc0-8080-b5090dd62da0 req-6f47e8d3-0a06-4299-b9a6-2d83d3993739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f73bf3-5727-4433-af9a-3e74fc2fda65", "name": "network-vif-deleted", "tag": "54847a88-94ca-45c7-910a-5fc6ab919b38"}]} {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:41:00.994330 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-25eabf18-1e3b-4fc0-8080-b5090dd62da0 req-6f47e8d3-0a06-4299-b9a6-2d83d3993739 service nova] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:00.994801 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-25eabf18-1e3b-4fc0-8080-b5090dd62da0 req-6f47e8d3-0a06-4299-b9a6-2d83d3993739 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:00.995231 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [req-25eabf18-1e3b-4fc0-8080-b5090dd62da0 req-6f47e8d3-0a06-4299-b9a6-2d83d3993739 service nova] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:01.008656 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.compute.server_external_events [req-25eabf18-1e3b-4fc0-8080-b5090dd62da0 req-6f47e8d3-0a06-4299-b9a6-2d83d3993739 service nova] Creating event network-vif-deleted:54847a88-94ca-45c7-910a-5fc6ab919b38 for instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 on hv-cinder-85829 Sep 19 12:41:01.013385 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [req-25eabf18-1e3b-4fc0-8080-b5090dd62da0 req-6f47e8d3-0a06-4299-b9a6-2d83d3993739 service nova] 10.222.0.88 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033912 Sep 19 12:41:01.014006 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1638/3328] 10.222.0.88 () {64 vars in 1317 bytes} [Mon Sep 19 12:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:41:01.392514 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:41:01.394006 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:41:01.400992 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:01.401419 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:01.402018 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:01.402649 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:01.403170 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:01.403743 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:01.435832 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:01.436322 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:01.436756 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:01.437202 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lazy-loading 'fault' on Instance uuid 16f73bf3-5727-4433-af9a-3e74fc2fda65 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:41:01.479792 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c6e6d0e00449eaabc76b1211ec8c43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a8601fd7bf4667a9b6901f6b4147cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:41:01.487676 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74ed3f0a-0ebd-4cd8-be12-423cd97a0f7b tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 200 len: 1222 microversion: 2.1 time: 0.099772 Sep 19 12:41:01.488251 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1691/3329] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:41:01 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:41:02.512756 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '>' {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:41:02.513355 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.compute.api [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] [instance: 16f73bf3-5727-4433-af9a-3e74fc2fda65] Fetching instance by UUID {{(pid=120644) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:41:02.519402 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:02.519873 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:02.520301 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:02.521102 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Acquiring lock "da7f277f-e3d5-498c-9c41-09e6e3516152" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:41:02.521564 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:41:02.521996 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG oslo_concurrency.lockutils [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Lock "da7f277f-e3d5-498c-9c41-09e6e3516152" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:41:02.535515 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.wsgi [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] HTTP exception thrown: Instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 could not be found. Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Request method failure captured: Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: request: GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 HTTP/1.1 Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept: application/json Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Accept-Encoding: identity Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Connection: close Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Length: 0 Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Content-Type: application/json Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Host: 10.222.0.88 Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: Openstack-System-Scope: None Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: User-Agent: python-urllib3/1.26.12 Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Auth-Token: gAAAAABjKGJKqz_BI3SUH_4JJ_GZC_cWKf_Z185lXYgRydwec2iyX-SYYPJqwhUBcMUgUDeiLIlC7IX4oMbRu4Nxjs6I7Cq9yRrpXjci27WTGJtoQpFOyUa-JW8aeU9Ztm-5yoq49WknWheCFb2-fYDDhDRJ_2KSiOwOyswtHrcmhyr3DtGOt6o Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Id: None Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Domain-Name: None Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Identity-Status: Confirmed Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Is-Admin-Project: True Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Id: default Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Domain-Name: Default Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Id: 84a8601fd7bf4667a9b6901f6b4147cf Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Project-Name: tempest-TestShelveInstance-305635855 Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Role: reader,member Sep 19 12:41:02.537103 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Roles: reader,member Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/84a8601fd7bf4667a9b6901f6b4147cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/compute/v2/84a8601fd7bf4667a9b6901f6b4147cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/volume/v3/84a8601fd7bf4667a9b6901f6b4147cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88:8080/v1/AUTH_84a8601fd7bf4667a9b6901f6b4147cf", "adminURL": "http://10.222.0.88:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.88/image"}]}] Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant: tempest-TestShelveInstance-305635855 Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Id: 84a8601fd7bf4667a9b6901f6b4147cf Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-Tenant-Name: tempest-TestShelveInstance-305635855 Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User: tempest-TestShelveInstance-305635855-project Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Id: default Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Domain-Name: Default Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Id: 49c6e6d0e00449eaabc76b1211ec8c43 Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: X-User-Name: tempest-TestShelveInstance-305635855-project Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: method: > Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: exception: Instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 could not be found. Sep 19 12:41:02.538737 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: action_args: {'id': '16f73bf3-5727-4433-af9a-3e74fc2fda65'} Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: {{(pid=120644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 could not be found. Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:41:02.539730 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 could not be found. Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 could not be found. Sep 19 12:41:02.541232 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: ERROR nova.api.openstack.wsgi Sep 19 12:41:02.542744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: DEBUG nova.api.openstack.wsgi [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Returning 404 to user: Instance 16f73bf3-5727-4433-af9a-3e74fc2fda65 could not be found. {{(pid=120644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:41:02.542744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: INFO nova.api.openstack.requestlog [None req-52d77134-64b9-4f08-921b-df292b5d83b9 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65" status: 404 len: 111 microversion: 2.1 time: 0.030486 Sep 19 12:41:02.542744 dv-cinder-858293-1-iscsi devstack@n-api.service[120644]: [pid: 120644|app: 0|req: 1639/3330] 10.222.0.88 () {58 vars in 1236 bytes} [Mon Sep 19 12:41:02 2022] GET /compute/v2.1/servers/16f73bf3-5727-4433-af9a-3e74fc2fda65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:41:02.699051 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d64fcc8e-3b54-4856-b6d4-a99eb71af9e4 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] Calling method '.version_select at 0x7f4ff9a025e0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:41:02.725365 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d64fcc8e-3b54-4856-b6d4-a99eb71af9e4 tempest-TestShelveInstance-305635855 tempest-TestShelveInstance-305635855-project] 10.222.0.88 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-41513703" status: 202 len: 0 microversion: 2.1 time: 0.029807 Sep 19 12:41:02.726199 dv-cinder-858293-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1692/3331] 10.222.0.88 () {58 vars in 1248 bytes} [Mon Sep 19 12:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-41513703 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)